hadoop 集群遇到的问题汇总

zhixingheyi_tian

已于 2025-03-17 15:39:41 修改

阅读量852

点赞数

分类专栏：大数据 hadoop源码 hadoop 文章标签： hadoop 大数据分布式

于 2018-11-12 09:43:06 首次发布

本文链接：https://blog.youkuaiyun.com/zhixingheyi_tian/article/details/83987027

版权

大数据同时被 3 个专栏收录

92 篇文章 ¥19.90 ¥99.00

订阅专栏

超级会员免费看

hadoop

36 篇文章

订阅专栏

hadoop源码

23 篇文章

订阅专栏

有时候报错会误导问题的定位和排查，比如下面这一款

org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/root/.sparkStaging/application_1539063128463_0573/__spark_libs__2844575839698714585.zip could only be replicated to 0 nodes instead of minReplication (=1).  There are 5 datanode(s) running and no node(s) are excluded in this operation.
	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1571)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3107)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3031)
	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:725)
	at org.apache.hadoop.hdfs.protoc