HDFS block丢失过多进入安全模式（safe mode）的解决方法

最新推荐文章于 2023-04-20 11:38:41 发布

大数据左右手

最新推荐文章于 2023-04-20 11:38:41 发布

阅读量1.9k

点赞数 2

分类专栏： Bug记录文章标签： HDFS 安全模式损坏块 fsck 修复

本文链接：https://blog.youkuaiyun.com/Hello_Java2018/article/details/115128232

版权

Bug记录专栏收录该内容

12 篇文章

订阅专栏

报错信息

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create file/user/root/.flink/application_1616479659685_0007/plugins/README.txt. Name node is in safe mode.
The reported blocks 5761 needs additional 14 blocks to reach the threshold 0.9990 of total blocks 5781.
The number of live datanodes 3 has reached the minimum number 1. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:devcdh2
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1439)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:2372)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:2318)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:771)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:451)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675)

查看HDFS block丢失情况

 hdfs fsck /

Connecting to namenode via http://devcdh2:9870/fsck?ugi=root&delete=1&path=%2F
FSCK started by root (auth:SIMPLE) from /192.168.6.76 for path / at Tue Mar 23 16:02:31 CST 2021

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/83c4457d-249d-4bbd-a7c6-dcc74eb61b53: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448618

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/83c4457d-249d-4bbd-a7c6-dcc74eb61b53: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448620

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/a1ff8d8b-e377-4d4b-a13b-f7d464d7386c: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448619

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/a1ff8d8b-e377-4d4b-a13b-f7d464d7386c: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/4e6cc205-6f92-49a7-b0af-13d28a2a3f93: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448623

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/4e6cc205-6f92-49a7-b0af-13d28a2a3f93: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448624

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/bdf1ed78-9c1c-4beb-a517-ca9ac407b6d4: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448622

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/bdf1ed78-9c1c-4beb-a517-ca9ac407b6d4: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/8bb95575-6366-4b33-bd75-5b27a503b94c: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448626

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/8bb95575-6366-4b33-bd75-5b27a503b94c: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448628

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/bc2a28b6-df8f-4d32-9ff9-635dd0687337: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448627

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/bc2a28b6-df8f-4d32-9ff9-635dd0687337: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/3c2b5cc6-4b14-480e-807a-2f8a1945bd79: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448630

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/3c2b5cc6-4b14-480e-807a-2f8a1945bd79: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/5efea232-a61a-4a9b-90bc-7b19fb1eebdc: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448631

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/5efea232-a61a-4a9b-90bc-7b19fb1eebdc: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448632

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/5eb9d4d3-62c6-4d06-9972-7bc6f0b19dbe: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448635

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/5eb9d4d3-62c6-4d06-9972-7bc6f0b19dbe: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/71bdf921-e9e8-443c-ad13-ce3e5f58c8de: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448634

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/71bdf921-e9e8-443c-ad13-ce3e5f58c8de: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448636

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/dbecccd1c9948bd10b9ed39062552d46/chk-16747/70d5887c-7987-4ef1-9317-b8993fa284e1:  Under replicated BP-199721927-192.168.6.76-1609304252767:blk_1073857082_116258. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).

/user/flink/checkpoint/dbecccd1c9948bd10b9ed39062552d46/chk-16747/_metadata:  Under replicated BP-199721927-192.168.6.76-1609304252767:blk_1073857084_116260. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).

/user/flink/checkpoint/dbecccd1c9948bd10b9ed39062552d46/chk-16747/eea2bc39-c441-4339-84cb-b5c994fe1ad2:  Under replicated BP-199721927-192.168.6.76-1609304252767:blk_1073857083_116259. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).

/user/flink/ha/completedCheckpoint09231ef9ff2b: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448633

/user/flink/ha/completedCheckpoint09231ef9ff2b: CORRUPT 1 blocks of total size 4505 B.
/user/flink/ha/completedCheckpoint5e461d0cf506: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448621

/user/flink/ha/completedCheckpoint5e461d0cf506: CORRUPT 1 blocks of total size 4505 B.
/user/flink/ha/completedCheckpoint740c86d9dede: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448625

/user/flink/ha/completedCheckpoint740c86d9dede: CORRUPT 1 blocks of total size 4505 B.
/user/flink/ha/completedCheckpointd5d2a51448b6: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448637

/user/flink/ha/completedCheckpointd5d2a51448b6: CORRUPT 1 blocks of total size 4505 B.
/user/flink/ha/completedCheckpointff0168a104e2: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448629

/user/flink/ha/completedCheckpointff0168a104e2: CORRUPT 1 blocks of total size 4505 B.
Status: CORRUPT
 Number of data-nodes:  3
 Number of racks:               1
 Total dirs:                    3883
 Total symlinks:                0

Replicated Blocks:
 Total size:    30817714125 B
 Total files:   5783
 Total blocks (validated):      5781 (avg. block size 5330862 B)
  ********************************
  UNDER MIN REPL'D BLOCKS:      20 (0.34596092 %)
  dfs.namenode.replication.min: 1
  CORRUPT FILES:        20
  CORRUPT BLOCKS:       20
  CORRUPT SIZE:         40955 B
  ********************************
 Minimally replicated blocks:   5761 (99.65404 %)
 Over-replicated blocks:        0 (0.0 %)
 Under-replicated blocks:       3 (0.051894136 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    3
 Average block replication:     2.9885833
 Missing blocks:                0
 Corrupt blocks:                20
 Missing replicas:              6 (0.03459609 %)
 Blocks queued for replication: 0

Erasure Coded Block Groups:
 Total size:    0 B
 Total files:   0
 Total block groups (validated):        0
 Minimally erasure-coded block groups:  0
 Over-erasure-coded block groups:       0
 Under-erasure-coded block groups:      0
 Unsatisfactory placement block groups: 0
 Average block group size:      0.0
 Missing block groups:          0
 Corrupt block groups:          0
 Missing internal blocks:       0
 Blocks queued for replication: 0
FSCK ended at Tue Mar 23 16:02:32 CST 2021 in 1798 milliseconds
FSCK ended at Tue Mar 23 16:02:32 CST 2021 in 1800 milliseconds
fsck encountered internal errors!


Fsck on path '/' FAILED
[root@devcdh1 data]# hadoop dfsadmin -safemode leave
WARNING: Use of this script to execute dfsadmin is deprecated.
WARNING: Attempting to execute replacement "hdfs dfsadmin" instead.

Safe mode is OFF in devcdh1/192.168.6.76:8020
Safe mode is OFF in devcdh2/192.168.6.77:8020
[root@devcdh1 data]# hdfs fsck  /  -delete
Connecting to namenode via http://devcdh2:9870/fsck?ugi=root&delete=1&path=%2F
FSCK started by root (auth:SIMPLE) from /192.168.6.76 for path / at Tue Mar 23 16:04:25 CST 2021

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/83c4457d-249d-4bbd-a7c6-dcc74eb61b53: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448618

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/83c4457d-249d-4bbd-a7c6-dcc74eb61b53: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448620

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/a1ff8d8b-e377-4d4b-a13b-f7d464d7386c: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448619

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47124/a1ff8d8b-e377-4d4b-a13b-f7d464d7386c: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/4e6cc205-6f92-49a7-b0af-13d28a2a3f93: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448623

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/4e6cc205-6f92-49a7-b0af-13d28a2a3f93: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448624

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/bdf1ed78-9c1c-4beb-a517-ca9ac407b6d4: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448622

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47125/bdf1ed78-9c1c-4beb-a517-ca9ac407b6d4: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/8bb95575-6366-4b33-bd75-5b27a503b94c: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448626

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/8bb95575-6366-4b33-bd75-5b27a503b94c: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448628

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/bc2a28b6-df8f-4d32-9ff9-635dd0687337: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448627

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47126/bc2a28b6-df8f-4d32-9ff9-635dd0687337: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/3c2b5cc6-4b14-480e-807a-2f8a1945bd79: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448630

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/3c2b5cc6-4b14-480e-807a-2f8a1945bd79: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/5efea232-a61a-4a9b-90bc-7b19fb1eebdc: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448631

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/5efea232-a61a-4a9b-90bc-7b19fb1eebdc: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448632

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47127/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/5eb9d4d3-62c6-4d06-9972-7bc6f0b19dbe: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448635

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/5eb9d4d3-62c6-4d06-9972-7bc6f0b19dbe: CORRUPT 1 blocks of total size 1535 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/71bdf921-e9e8-443c-ad13-ce3e5f58c8de: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448634

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/71bdf921-e9e8-443c-ad13-ce3e5f58c8de: CORRUPT 1 blocks of total size 1240 B.
/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/_metadata: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448636

/user/flink/checkpoint/39e8593bbff53abc516aeeffeaf549bc/chk-47128/_metadata: CORRUPT 1 blocks of total size 911 B.
/user/flink/checkpoint/dbecccd1c9948bd10b9ed39062552d46/chk-16747/70d5887c-7987-4ef1-9317-b8993fa284e1:  Under replicated BP-199721927-192.168.6.76-1609304252767:blk_1073857082_116258. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).

/user/flink/checkpoint/dbecccd1c9948bd10b9ed39062552d46/chk-16747/_metadata:  Under replicated BP-199721927-192.168.6.76-1609304252767:blk_1073857084_116260. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).

/user/flink/checkpoint/dbecccd1c9948bd10b9ed39062552d46/chk-16747/eea2bc39-c441-4339-84cb-b5c994fe1ad2:  Under replicated BP-199721927-192.168.6.76-1609304252767:blk_1073857083_116259. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).

/user/flink/ha/completedCheckpoint09231ef9ff2b: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448633

/user/flink/ha/completedCheckpoint09231ef9ff2b: CORRUPT 1 blocks of total size 4505 B.
/user/flink/ha/completedCheckpoint5e461d0cf506: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448621

/user/flink/ha/completedCheckpoint5e461d0cf506: CORRUPT 1 blocks of total size 4505 B.
/user/flink/ha/completedCheckpoint740c86d9dede: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448625

/user/flink/ha/completedCheckpoint740c86d9dede: CORRUPT 1 blocks of total size 4505 B.
/user/flink/ha/completedCheckpointd5d2a51448b6: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448637

/user/flink/ha/completedCheckpointd5d2a51448b6: CORRUPT 1 blocks of total size 4505 B.
/user/flink/ha/completedCheckpointff0168a104e2: CORRUPT blockpool BP-199721927-192.168.6.76-1609304252767 block blk_1075448629

/user/flink/ha/completedCheckpointff0168a104e2: CORRUPT 1 blocks of total size 4505 B.
Status: CORRUPT
 Number of data-nodes:  3
 Number of racks:               1
 Total dirs:                    3883
 Total symlinks:                0

Replicated Blocks:
 Total size:    30817714125 B
 Total files:   5783
 Total blocks (validated):      5781 (avg. block size 5330862 B)
  ********************************
  UNDER MIN REPL'D BLOCKS:      20 (0.34596092 %)
  dfs.namenode.replication.min: 1
  CORRUPT FILES:        20
  CORRUPT BLOCKS:       20
  CORRUPT SIZE:         40955 B
  ********************************
 Minimally replicated blocks:   5761 (99.65404 %)
 Over-replicated blocks:        0 (0.0 %)
 Under-replicated blocks:       3 (0.051894136 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    3
 Average block replication:     2.9885833
 Missing blocks:                0
 Corrupt blocks:                20
 Missing replicas:              6 (0.03459609 %)
 Blocks queued for replication: 0

Erasure Coded Block Groups:
 Total size:    0 B
 Total files:   0
 Total block groups (validated):        0
 Minimally erasure-coded block groups:  0
 Over-erasure-coded block groups:       0
 Under-erasure-coded block groups:      0
 Unsatisfactory placement block groups: 0
 Average block group size:      0.0
 Missing block groups:          0
 Corrupt block groups:          0
 Missing internal blocks:       0
 Blocks queued for replication: 0
FSCK ended at Tue Mar 23 16:04:26 CST 2021 in 763 milliseconds


The filesystem under path '/' is CORRUPT

解决方案

 hadoop dfsadmin -safemode leave


// 注意，用delete会造成数据的丢失，

 hdfs fsck  /  -delete

Status: HEALTHY
 Number of data-nodes:  3
 Number of racks:               1
 Total dirs:                    3883
 Total symlinks:                0

Replicated Blocks:
 Total size:    30817673170 B
 Total files:   5763
 Total blocks (validated):      5761 (avg. block size 5349361 B)
 Minimally replicated blocks:   5761 (100.0 %)
 Over-replicated blocks:        0 (0.0 %)
 Under-replicated blocks:       3 (0.05207429 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    3
 Average block replication:     2.9989586
 Missing blocks:                0
 Corrupt blocks:                0
 Missing replicas:              6 (0.034716196 %)
 Blocks queued for replication: 0

Erasure Coded Block Groups:
 Total size:    0 B
 Total files:   0
 Total block groups (validated):        0
 Minimally erasure-coded block groups:  0
 Over-erasure-coded block groups:       0
 Under-erasure-coded block groups:      0
 Unsatisfactory placement block groups: 0
 Average block group size:      0.0
 Missing block groups:          0
 Corrupt block groups:          0
 Missing internal blocks:       0
 Blocks queued for replication: 0
FSCK ended at Tue Mar 23 16:04:57 CST 2021 in 452 milliseconds


The filesystem under path '/' is HEALTHY

再次查看状态

hadoop fsck /