Hadoop集群安装 (3) 配置conf/hdfs-site.xml

最新推荐文章于 2022-04-27 11:38:28 发布

原创最新推荐文章于 2022-04-27 11:38:28 发布 · 1.2w 阅读

3 ·

CC 4.0 BY-SA版权

文章标签：

#hadoop #集群 #table

Hadoop 专栏收录该内容

22 篇文章

订阅专栏

本文详细介绍了如何配置Hadoop的NameNode和DataNode目录、副本度和块大小，包括dfs.name.dir、dfs.data.dir、dfs.replication和dfs.block.size等关键属性的设定。

1. 配置NameNode和DataNode的目录 ()

说明：配置dfs.name.dir 和 dfs.data.dir

<property>
	<name>dfs.namenode.name.dir</name>
	<value>file://${hadoop.tmp.dir}/dfs/name</value>
	<description>Determines where on the local filesystem the DFS name node
		should store the name table(fsimage).  If this is a comma-delimited list
		of directories then the name table is replicated in all of the
		directories, for redundancy. </description>
</property>


<property>
	<name>dfs.datanode.data.dir</name>
	<value>file://${hadoop.tmp.dir}/dfs/data</value>
	<description>Determines where on the local filesystem an DFS data node
		should store its blocks.  If this is a comma-delimited
		list of directories, then data will be stored in all named
		directories, typically on different devices.
		Directories that do not exist are ignored.
	</description>
</property>

2. 配置副本度

<property>  
        <name>dfs.replication</name>  
        <value>2</value>  
</property>

3. 设置块大小

<property>    
        <name>dfs.block.size</name>    
        <value>134217728</value>    
</property>
64M:	67108864
32M:	33554432
16M:	16777216
8M:		8388608
4M:		4194304