Incompatible namespaceID for journal Storage Directory ...

最新推荐文章于 2023-10-07 09:31:23 发布

原创最新推荐文章于 2023-10-07 09:31:23 发布 · 5.1k 阅读

0 ·

CC 4.0 BY-SA版权

hadoop错误专栏收录该内容

30 篇文章

订阅专栏

本文详细解析了一个Hadoop集群中出现的致命错误，即在进行格式化操作时，Namenode生成了新的namespaceID，而journal节点中的namespaceID与Namenode不同，导致无法实现quorum状态。文章提供了解决方案，建议将实例回滚到previousversion以解决此问题。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Question:

2014-04-15 15:00:02,235 FATAL org.apache.hadoop.hdfs.server.namenode.FSEditLog: Error: recoverUnfinalizedSegments failed for required journal (JournalAndStream(mgr=QJM to [172.16.19.21:8485, 172.16.19.22:8485, 172.16.19.23:8485], stream=null))
org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 3 exceptions thrown:
172.16.19.22:8485: Incompatible namespaceID for journal Storage Directory /home/hkx/journaldata/ns2: NameNode has nsId 480343035 but storage has nsId 2072447892
	at org.apache.hadoop.hdfs.qjournal.server.JNStorage.checkConsistentNamespace(JNStorage.java:202)
	at org.apache.hadoop.hdfs.qjournal.server.Journal.newEpoch(Journal.java:286)
	at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.newEpoch(JournalNodeRpcServer.java:132)
	at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.newEpoch(QJournalProtocolServerSideTranslatorPB.java:114)
	at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:17439)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2048)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2044)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2042)