Windows环境下eclipse提交到远程wordcount程序报错 at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)

最新推荐文章于 2022-08-16 16:41:02 发布

Scojen

最新推荐文章于 2022-08-16 16:41:02 发布

阅读量5.9k

点赞数 4

CC 4.0 BY-SA版权

分类专栏： Hadoop mapreduce 文章标签： hadoop wordcount ExitCodeException runCommand windows

本文链接：https://blog.youkuaiyun.com/www_jun/article/details/49357535

Hadoop 同时被 2 个专栏收录

5 篇文章

订阅专栏

mapreduce

1 篇文章

订阅专栏

本文提供了解决使用Hadoop版本2.7远程连接Windows7时遇到的报错问题的方法，包括下载并正确配置winutils.exe文件以避免dll缺失错误，从而使得wordcount程序可以正常执行。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

远程hadoop2.7，本地的windows7
程序报错如下：
2015-09-28 22:04:21,423 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
aaa
2015-09-28 22:04:22,973 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-09-28 22:04:22,975 INFO [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
Exception in thread "main" ExitCodeException exitCode=-1073741515:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:815)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:798)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:728)
at org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:486)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:526)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:504)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:305)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:133)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:147)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
at hadoop2.wordcount.main(wordcount.java:53)

解决办法：
下载对应版本（或者更高版本）的winutils.exe复制到本地HDOOP_HOME下bin目录下，并保证winutils.exe双击运行没有报***.dll 缺失的错误。
如果缺失***.dll下载对应的vs++ ，重启电脑运行winutils.exe不报错，wordcount即可执行。