首次部署hadoop ，namenode 格式化失败 storage directory does not exist or is not accessible

最新推荐文章于 2024-07-27 12:02:57 发布

原创最新推荐文章于 2024-07-27 12:02:57 发布 · 2.7k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#storage directory does not exi #namenode 格式化失败 #首次部署hadoop

在2018年12月尝试首次部署Hadoop时遇到了问题，namenode格式化失败，报错为'storage directory does not exist or is not accessible'。错误出现在尝试加载fsimage时，/usr/local/hadoop/tmp/dfs/name存储目录不存在或不可访问。解决方案包括检查配置文件和确保SSH无密码登录设置正确。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

2018-12-07 16:49:44,171 INFO org.apache.hadoop.util.GSet: capacity      = 2^15 = 32768 entries
2018-12-07 16:49:44,174 WARN org.apache.hadoop.hdfs.server.common.Storage: Storage directory /usr/local/hadoop/tmp/dfs/name does not exist
2018-12-07 16:49:44,175 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Encountered exception loading fsimage
org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /usr/local/hadoop/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
        at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:322)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:210)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1012)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:691)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:634)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:695)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:898)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:877)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1603)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1671)
2018-12-07 16:49:44,178 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
2018-12-07 16:49:44,278 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...
2018-12-07 16:49:44,279 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.
2018-12-07 16:49:44,279 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete.
2018-12-07 16:49:44,279 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /usr/local/hadoop/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
        at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:322)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:210)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1012)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:691)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:634)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:695)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:898)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:877)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1603)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1671)
2018-12-07 16:49:44,280 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
2018-12-07 16:49:44,281 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at tsing-QTJ5/127.0.1.1
************************************************************/
2018-12-07 17:25:59,328 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:

原因分析：

1、配置文件书写错误，重新查看配置文件

Hadoop 的配置文件位于 /usr/local/hadoop/etc/hadoop/ 中，伪分布式需要修改2个配置文件 core-site.xml 和 hdfs-site.xml

参考 https://www.cnblogs.com/87hbteo/p/7606012.html 中的四、伪分布式配置

2、没有登录ssh

解决：安装ssh并且设置无密码登录是前提，然后

登录账户：$ ssh localhost