org.apache.hadoop.io.nativeio.NativeIO$Windows.createDirectoryWithMode0(Ljava/lang/String;I)V的解决方案

最新推荐文章于 2021-04-03 19:52:36 发布

muyingmiao

最新推荐文章于 2021-04-03 19:52:36 发布

阅读量2.7k

点赞数 5

分类专栏： Hadoop 文章标签： mapreduce org.apache.hadoop.io.nativeio.

本文链接：https://blog.youkuaiyun.com/muyingmiao/article/details/100101584

版权

在Windows环境下，使用Hadoop MapReduce编程遇到`org.apache.hadoop.io.nativeio.NativeIO$Windows.createDirectoryWithMode0(Ljava/lang/String;I)V`错误。该问题涉及Hadoop的依赖文件配置，解决方案包括下载特定版本的hadoop.dll和winutils.exe，将其放入正确目录，并设置环境变量。通过这些步骤，问题最终得以解决。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

最近编写了一个mapreduce程序，在IDEA中执行发现出现这个问题，百度各种方案都不行，花了好久才解决，现在把最近看过和亲测过的方案整理如下，希望能让别人早日出坑。报错信息如下：

19/08/27 10:36:57 ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
	at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:407)
	at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:422)
	at org.apache.hadoop.util.Shell.<clinit>(Shell.java:415)
	at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
	at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:168)
	at org.apache.hadoop.security.Groups.<init>(Groups.java:132)
	at org.apache.hadoop.security.Groups.<init>(Groups.java:100)
	at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:435)
	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:341)
	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:308)
	at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:895)
	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:861)
	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:728)
	at org.apache.hadoop.mapreduce.task.JobContextImpl.<init>(JobContextImpl.java:72)
	at org.apache.hadoop.mapreduce.Job.<init>(Job.java:145)
	at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:188)
	at com.wxx.bigdata.hadoop.mapreduce.wc.WordCountApp.main(WordCountApp.java:24)
19/08/27 10:36:58 INFO deprecation: session.id is deprecated. Inste

最低0.47元/天解锁文章