hadoop 伪分布式执行wordcount失败

最新推荐文章于 2024-08-06 22:59:32 发布

转载最新推荐文章于 2024-08-06 22:59:32 发布 · 542 阅读

0 ·

CC 4.0 BY-SA版权

原文链接：https://my.oschina.net/u/3618851/blog/3075867

文章标签：

#大数据 #java #shell

在执行wordcount时明显内存和cpu飙升 1核1G的服务器瞬间沦陷内存不够会导致失败

错误信息如下

Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:585)
        at org.apache.hadoop.util.Shell.run(Shell.java:482)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)


Container exited with a non-zero exit code 1

转载于:https://my.oschina.net/u/3618851/blog/3075867