WARNING : There are about 34 missing blocks. Please check the log or run fsck.

'jifeng01:9000'

Started:	Sat Sep 06 22:41:47 CST 2014
Version:	1.2.1, 1503152
Compiled:	Mon Jul 22 15:23:09 PDT 2013 by mattf

Browse the filesystem  
jifeng01:9000 Logs  
Go back to DFS home

---

Reported Corrupt Files

blk_-6457274919514896544 /home/jifeng/out/part-m-00004
blk_-5584297838940778022 /user/jifeng/output/random-seeds/part-randomSeed
blk_-5243301279492742263 /user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929
blk_-3888018766322651506 /home/jifeng/out/part-m-00009
blk_-2853897503049953015 /home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml
blk_-2825733319432881440 /home/jifeng/pids/part-m-00007.seq
blk_-2049677542258916799 /user/jifeng/testdata/synthetic_control.data
blk_-1403735329502570594 /user/jifeng/hbase/scores/.tableinfo.0000000001
blk_-1329383103204158484 /user/jifeng/output/clusters-2/_policy
blk_-1092299033788448642 /user/jifeng/hbase/-ROOT-/70236052/.regioninfo
blk_-959108783924676624 /user/jifeng/output/clusters-4/_policy
blk_-824171596733300207 /home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml
blk_-703416978362433992 /user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat
blk_-68589977821710110 /user/jifeng/hbase/-ROOT-/.tableinfo.0000000001
blk_109205275959958993 /user/jifeng/output/_policy
blk_575730840927164662 /user/jifeng/hbase/hbase.id
blk_928839098900765633 /home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob
blk_2369857512018989453 /user/jifeng/output/clusters-3/part-r-00000
blk_3764002349176068586 /user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml
blk_3852612576123523390 /home/jifeng/pids/part-m-00003.seq
blk_3910032104823961563 /user/jifeng/output/clusters-0/part-00003
blk_4314247290342042317 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml
blk_5877660712985883910 /user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75
blk_5976038500197801228 /user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3
blk_7396752195048257419 /user/jifeng/output/clusters-7/part-r-00000
blk_7422539300806584926 /user/jifeng/output/clusters-6/_policy
blk_7768269153299453904 /home/jifeng/pids/part-m-00000.seq
blk_7907833205724261986 /user/jifeng/output/clusters-0/part-00004
blk_8225354003048181368 /user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml
blk_8644617765668849324 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat
blk_8725357001115122394 /home/jifeng/out/part-m-00001
blk_9080037511646150766 /user/jifeng/output/clusters-8/part-r-00000
blk_9171939222431302382 /home/jifeng/pids/part-m-00002.seq

Total: At least 33 corrupt file(s)

检查损坏的hdfs文件列表 使用命令可以打印出损坏的文件列表: hadoop fsck 
没有冗余备份,只能删除损坏的文件,使用命令: hadoop fsck --delete

[jifeng@jifeng01 hbase-0.94.21]$ hadoop fsck --delete  
Warning: $HADOOP_HOME is deprecated.

FSCK started by jifeng from /10.5.4.54 for path / at Sat Sep 06 23:05:11 CST 2014
.
/home/jifeng/hadoop/tmp/mapred/staging/jifeng/.staging/job_201408132307_0012/job.jar:  Under replicated blk_-4953605809636462967_1091. Target Replicas is 10 but found 3 replica(s).
.
/home/jifeng/hadoop/tmp/mapred/staging/jifeng/.staging/job_201408132307_0015/job.jar:  Under replicated blk_-3894987090632193800_1108. Target Replicas is 10 but found 3 replica(s).
...
/home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob: CORRUPT block blk_928839098900765633

/home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob: MISSING 1 blocks of total size 44200 B..
/home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml: CORRUPT block blk_-2853897503049953015

/home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml: MISSING 1 blocks of total size 56963 B...
/home/jifeng/out/part-m-00001: CORRUPT block blk_8725357001115122394

/home/jifeng/out/part-m-00001: MISSING 1 blocks of total size 8626 B....
/home/jifeng/out/part-m-00004: CORRUPT block blk_-6457274919514896544

/home/jifeng/out/part-m-00004: MISSING 1 blocks of total size 8440 B......
/home/jifeng/out/part-m-00009: CORRUPT block blk_-3888018766322651506

/home/jifeng/out/part-m-00009: MISSING 1 blocks of total size 2287 B....
/home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml: CORRUPT block blk_-824171596733300207

/home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml: MISSING 1 blocks of total size 56968 B..
/home/jifeng/pids/part-m-00000.seq: CORRUPT block blk_7768269153299453904

/home/jifeng/pids/part-m-00000.seq: MISSING 1 blocks of total size 7499 B...
/home/jifeng/pids/part-m-00002.seq: CORRUPT block blk_9171939222431302382

/home/jifeng/pids/part-m-00002.seq: MISSING 1 blocks of total size 9319 B..
/home/jifeng/pids/part-m-00003.seq: CORRUPT block blk_3852612576123523390

/home/jifeng/pids/part-m-00003.seq: MISSING 1 blocks of total size 9138 B.....
/home/jifeng/pids/part-m-00007.seq: CORRUPT block blk_-2825733319432881440

/home/jifeng/pids/part-m-00007.seq: MISSING 1 blocks of total size 86 B..............
/user/jifeng/hbase/-ROOT-/.tableinfo.0000000001: CORRUPT block blk_-68589977821710110

/user/jifeng/hbase/-ROOT-/.tableinfo.0000000001: MISSING 1 blocks of total size 728 B...
/user/jifeng/hbase/-ROOT-/70236052/.regioninfo: CORRUPT block blk_-1092299033788448642

/user/jifeng/hbase/-ROOT-/70236052/.regioninfo: MISSING 1 blocks of total size 109 B..
/user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75: CORRUPT block blk_5877660712985883910

/user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75: MISSING 1 blocks of total size 1067 B....
/user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3: CORRUPT block blk_5976038500197801228

/user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3: MISSING 1 blocks of total size 1473 B..
/user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929: CORRUPT block blk_-5243301279492742263

/user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929: MISSING 1 blocks of total size 134 B...
/user/jifeng/hbase/hbase.id: CORRUPT block blk_575730840927164662

/user/jifeng/hbase/hbase.id: MISSING 1 blocks of total size 38 B.......
/user/jifeng/hbase/scores/.tableinfo.0000000001: CORRUPT block blk_-1403735329502570594

/user/jifeng/hbase/scores/.tableinfo.0000000001: MISSING 1 blocks of total size 1273 B...........................
/user/jifeng/output/_policy: CORRUPT block blk_109205275959958993

/user/jifeng/output/_policy: MISSING 1 blocks of total size 194 B..........
/user/jifeng/output/clusters-0/part-00003: CORRUPT block blk_3910032104823961563

/user/jifeng/output/clusters-0/part-00003: MISSING 1 blocks of total size 1891 B..
/user/jifeng/output/clusters-0/part-00004: CORRUPT block blk_7907833205724261986

/user/jifeng/output/clusters-0/part-00004: MISSING 1 blocks of total size 1891 B.....
/user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml: CORRUPT block blk_8225354003048181368

/user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml: MISSING 1 blocks of total size 50269 B......
......
/user/jifeng/output/clusters-2/_policy: CORRUPT block blk_-1329383103204158484

/user/jifeng/output/clusters-2/_policy: MISSING 1 blocks of total size 194 B....
/user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat: CORRUPT block blk_8644617765668849324

/user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat: MISSING 1 blocks of total size 13899 B..
/user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml: CORRUPT block blk_4314247290342042317

/user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml: MISSING 1 blocks of total size 50269 B...
/user/jifeng/output/clusters-3/part-r-00000: CORRUPT block blk_2369857512018989453

/user/jifeng/output/clusters-3/part-r-00000: MISSING 1 blocks of total size 7581 B...
/user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat: CORRUPT block blk_-703416978362433992

/user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat: MISSING 1 blocks of total size 13893 B...
/user/jifeng/output/clusters-4/_policy: CORRUPT block blk_-959108783924676624

/user/jifeng/output/clusters-4/_policy: MISSING 1 blocks of total size 194 B...........
/user/jifeng/output/clusters-6/_policy: CORRUPT block blk_7422539300806584926

/user/jifeng/output/clusters-6/_policy: MISSING 1 blocks of total size 194 B.......
/user/jifeng/output/clusters-7/part-r-00000: CORRUPT block blk_7396752195048257419

/user/jifeng/output/clusters-7/part-r-00000: MISSING 1 blocks of total size 7581 B......
/user/jifeng/output/clusters-8/part-r-00000: CORRUPT block blk_9080037511646150766

/user/jifeng/output/clusters-8/part-r-00000: MISSING 1 blocks of total size 7581 B.........
/user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml: CORRUPT block blk_3764002349176068586

/user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml: MISSING 1 blocks of total size 49204 B...
/user/jifeng/output/random-seeds/part-randomSeed: CORRUPT block blk_-5584297838940778022

/user/jifeng/output/random-seeds/part-randomSeed: MISSING 1 blocks of total size 7750 B...
/user/jifeng/testdata/synthetic_control.data: CORRUPT block blk_-2049677542258916799

/user/jifeng/testdata/synthetic_control.data: MISSING 1 blocks of total size 288374 B.Status: CORRUPT
 Total size:    1304321705 B
 Total dirs:    121
 Total files:   149
 Total blocks (validated):      143 (avg. block size 9121130 B)
  ********************************
  CORRUPT FILES:        33
  MISSING BLOCKS:       33
  MISSING SIZE:         709307 B
  CORRUPT BLOCKS:       33
  ********************************
 Minimally replicated blocks:   110 (76.92308 %)
 Over-replicated blocks:        0 (0.0 %)
 Under-replicated blocks:       2 (1.3986014 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    1
 Average block replication:     0.8811189
 Corrupt blocks:                33
 Missing replicas:              14 (11.111111 %)
 Number of data-nodes:          3
 Number of racks:               1
FSCK ended at Sat Sep 06 23:05:11 CST 2014 in 22 milliseconds


The filesystem under path '/' is CORRUPT
[jifeng@jifeng01 hbase-0.94.21]$