hadoop 执行命令错误Call From XXX failed on connection exception: ConnectException: Connection refused

最新推荐文章于 2023-12-09 19:45:34 发布

原创最新推荐文章于 2023-12-09 19:45:34 发布 · 3.8k 阅读

1 ·

CC 4.0 BY-SA版权

文章标签：

#Hadoop #haddoop connection #hadoop error #hadoop doCheckpoint

2019年8月专栏收录该内容

2 篇文章

订阅专栏

错误：hadoop 启动之后，运行任何命令都会出现错误：Call From XXX to XXX failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

原因：这是因为yarn-site.xml文件没配置好。yarn.nodemanager.address没有配置，默认是0.0.0.0:0。请参照官方文档进行配置。

日志错误原因：ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Log not rolled. Name node is in safe mode.
The reported blocks 29120 needs additional 34892 blocks to reach the threshold 0.9990 of total blocks 64076.
The number of live datanodes 9 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1364)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.rollEditLog(FSNamesystem.java:6340)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.rollEditLog(NameNodeRpcServer.java:933)
at org.apache.hadoop.hdfs.protocolPB.NamenodeProtocolServerSideTranslatorPB.rollEditLog(NamenodeProtocolServerSideTranslatorPB.java:139)
at org.apache.hadoop.hdfs.protocol.proto.NamenodeProtocolProtos$NamenodeProtocolService$2.callBlockingMethod(NamenodeProtocolProtos.java:11214)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2039)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2035)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2033)

上边的错误主要是由于hadoop启动时，丢失的数据块过多，导致启动namenode的安全模式，如果想要关闭安全模式，可以执行hdfs dfsadmin -safemode leave