org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block:

最新推荐文章于 2022-04-14 13:52:50 发布

乖乖猪001

最新推荐文章于 2022-04-14 13:52:50 发布

阅读量8.3k

点赞数 4

CC 4.0 BY-SA版权

分类专栏：大数据

本文链接：https://blog.youkuaiyun.com/xiaozhaoshigedasb/article/details/88999595

大数据专栏收录该内容

72 篇文章

订阅专栏

本文提供了Hadoop集群中常见问题的解决办法，包括检查防火墙设置、验证DataNode状态及如何使用hadoop fsck命令来查找并修复损坏的数据块。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

防火墙记得关掉；
查看DataNode是否启动；
有些数据块是损坏了，可以命令查看

hadoop fsck  <path>

然后可以删除损坏的数据块

hadoop fsck  <path> -delete

hadoop fsck其他参数解释：

 <path>  start checking from this path
        -move   move corrupted files to /lost+found
        -delete delete corrupted files
        -files  print out files being checked
        -openforwrite   print out files opened for write
        -includeSnapshots       include snapshot data if the given path indicates a snapshottable directory or there are snapshottable directories under it
        -list-corruptfileblocks print out list of missing blocks and files they belong to
        -blocks print out block report
        -locations      print out locations for every block
        -racks  print out network topology for data-node locations

        -maintenance    print out maintenance state node details
        -blockId        print out which file this blockId belongs to, locations (nodes, racks) of this block, and other diagnostics info (under replicated, corrupted or not, etc)