idea中跑mapreduce报错, PATH设置错误

最新推荐文章于 2024-04-05 07:00:00 发布

转载最新推荐文章于 2024-04-05 07:00:00 发布 · 101 阅读

0 ·

CC 4.0 BY-SA版权

原文链接：http://www.cnblogs.com/mediocreWorld/p/11204621.html

文章标签：

#开发工具 #java #大数据

本文记录了一次使用Hadoop过程中遇到的连接拒绝错误，并详细解释了如何通过检查和修改Step1Main.java文件中的HDFS路径配置来解决问题。

问题如题，报错：

[root@node01 servers]# hadoop jar loginVisit.jar cn.itcast.loginVisit.step1.Step1Main
19/07/17 22:14:59 INFO client.RMProxy: Connecting to ResourceManager at node01/192.168.8.100:8032
19/07/17 22:14:59 WARN security.UserGroupInformation: PriviledgedActionException as:root (auth:SIMPLE) cause:java.net.ConnectException: Call From node01.hadoop.com/192.168.8.100 to node02:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
Exception in thread "main" java.net.ConnectException: Call From node01.hadoop.com/192.168.8.100 to node02:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

原因：

Step1Main.java中，path设置错误：

TextOutputFormat.setOutputPath(job,new Path("hdfs://node02:8020/loginVisit/output3"));

其中node02要改为node01.

严重怀疑代码被idea莫名其妙地修改了！

转载于:https://www.cnblogs.com/mediocreWorld/p/11204621.html