Hadoop 查看某个文件分成几个块,分别在那台机架的哪个机器上

博客提及命令,包含块的位置信息和副本信息,转载自https://blog.51cto.com/14309075/2396136 。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

命令是

hadoop fsck /g6/input/baidu.log -files -blocks -locations -racks
[hadoop@hadoop002 ~]$ hadoop fsck /g6/input/baidu.log -files -blocks -locations -racks
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

Connecting to namenode via http://hadoop001:50070
FSCK started by hadoop (auth:SIMPLE) from /192.168.1.202 for path /g6/input/baidu.log at Fri May 17 07:17:29 EDT 2019
/g6/input/baidu.log 709286098 bytes, 3 block(s):  OK
0. BP-1964109503-192.168.1.201-1557058616667:blk_1073741939_1115 len=268435456 Live_repl=3 [/default-rack/192.168.1.203:50010, /default-rack/192.168.1.202:50010, /default-rack/192.168.1.201:50010]
1. BP-1964109503-192.168.1.201-1557058616667:blk_1073741940_1116 len=268435456 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]
2. BP-1964109503-192.168.1.201-1557058616667:blk_1073741941_1117 len=172415186 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]

Status: HEALTHY
 Total size:    709286098 B
 Total dirs:    0
 Total files:   1
 Total symlinks:        0
 Total blocks (validated):  3 (avg. block size 236428699 B)
 Minimally replicated blocks:   3 (100.0 %)
 Over-replicated blocks:    3 (100.0 %)
 Under-replicated blocks:   0 (0.0 %)
 Mis-replicated blocks:     0 (0.0 %)
 Default replication factor:    2
 Average block replication: 3.0
 Corrupt blocks:        0
 Missing replicas:      0 (0.0 %)
 Number of data-nodes:      3
 Number of racks:       1
FSCK ended at Fri May 17 07:17:29 EDT 2019 in 3 milliseconds

The filesystem under path '/g6/input/baidu.log' is HEALTHY

下方这部分信息就是块的位置信息和副本信息

0. BP-1964109503-192.168.1.201-1557058616667:blk_1073741939_1115 len=268435456 Live_repl=3 [/default-rack/192.168.1.203:50010, /default-rack/192.168.1.202:50010, /default-rack/192.168.1.201:50010]
1. BP-1964109503-192.168.1.201-1557058616667:blk_1073741940_1116 len=268435456 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]
2. BP-1964109503-192.168.1.201-1557058616667:blk_1073741941_1117 len=172415186 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]

转载于:https://blog.51cto.com/14309075/2396136

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值