Closed
Description
No FileSystem for scheme "file"
org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "file"
As reported in Slack: https://kotlinlang.slack.com/archives/C4W52CFEZ/p1654119134612899
Related issue: https://stackoverflow.com/questions/17265002/hadoop-no-filesystem-for-scheme-file/27532248#27532248
Fix:
Add
props = mapOf(
"fs.hdfs.impl" to org.apache.hadoop.hdfs.DistributedFileSystem::class.java.name,
"fs.file.impl" to org.apache.hadoop.fs.LocalFileSystem::class.java.name,
)
to withSpark
call
Metadata
Metadata
Assignees
Labels
No labels