Hadoop 查看某个文件分成几个块，分别在那台机架的哪个机器上

Hadoop 查看某个文件分成几个块，分别在那台机架的哪个机器上

命令是

hadoop fsck /g6/input/baidu.log -files -blocks -locations -racks

[hadoop@hadoop002 ~]$ hadoop fsck /g6/input/baidu.log -files -blocks -locations -racks DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. Connecting to namenode via http://hadoop001:50070 FSCK started by hadoop (auth:SIMPLE) from /192.168.1.202 for path /g6/input/baidu.log at Fri May 17 07:17:29 EDT 2019 /g6/input/baidu.log 709286098 bytes, 3 block(s): OK 0. BP-1964109503-192.168.1.201-1557058616667:blk_1073741939_1115 len=268435456 Live_repl=3 [/default-rack/192.168.1.203:50010, /default-rack/192.168.1.202:50010, /default-rack/192.168.1.201:50010] 1. BP-1964109503-192.168.1.201-1557058616667:blk_1073741940_1116 len=268435456 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010] 2. BP-1964109503-192.168.1.201-1557058616667:blk_1073741941_1117 len=172415186 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010] Status: HEALTHY Total size: 709286098 B Total dirs: 0 Total files: 1 Total symlinks: 0 Total blocks (validated): 3 (avg. block size 236428699 B) Minimally replicated blocks: 3 (100.0 %) Over-replicated blocks: 3 (100.0 %) Under-replicated blocks: 0 (0.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 2 Average block replication: 3.0 Corrupt blocks: 0 Missing replicas: 0 (0.0 %) Number of data-nodes: 3 Number of racks: 1 FSCK ended at Fri May 17 07:17:29 EDT 2019 in 3 milliseconds The filesystem under path '/g6/input/baidu.log' is HEALTHY

下方这部分信息就是块的位置信息和副本信息

0. BP-1964109503-192.168.1.201-1557058616667:blk_1073741939_1115 len=268435456 Live_repl=3 [/default-rack/192.168.1.203:50010, /default-rack/192.168.1.202:50010, /default-rack/192.168.1.201:50010] 1. BP-1964109503-192.168.1.201-1557058616667:blk_1073741940_1116 len=268435456 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010] 2. BP-1964109503-192.168.1.201-1557058616667:blk_1073741941_1117 len=172415186 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]

版权声明：本文内容由网络用户投稿，版权归原作者所有，本站不拥有其著作权，亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容，请联系我们jiasou666@gmail.com 处理，核实后本网站将在24小时内删除侵权内容。