Spark WordCount执行报错：Exception in thread “main“ java.lang.UnsatisfiedLinkError

徐凤年不是真无敌

于 2022-02-28 17:06:18 发布

阅读量449

点赞数

本文链接：https://blog.youkuaiyun.com/AriesLY0411/article/details/123186794

版权

该博客讨论了一个在运行Spark程序时遇到的错误，具体表现为`UnsatisfiedLinkError`，原因是本地IO操作失败。问题出在尝试通过NativeIO读取文件时，无法找到对应的库方法。代码示例中展示了`Spark01_WordCount`应用，其目的是对输入文件进行词频统计。解决方案是确保在调用`sc.textFile`时提供正确的文件路径。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;
	at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)
	at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:460)
	at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:821)
	at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:735)
	at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:703)
	at org.apache.hadoop.fs.LocatedFileStatus.<init>(LocatedFileStatus.java:52)
	at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:2091)
	at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:2071)
	at org.apache.hadoop.mapred.FileInputFormat.single