Ubuntu16.04搭建完全分布式hadoop-2.7.4

1.hdfs-site.xml:

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
    <property>
        <name>dfs.namenode.secondary.http-address</name>
        <value>node2:50090</value>
    </property>
    <property>
        <name>dfs.namenode.secondary.https-address</name>
        <value>node2:50091</value>
    </property>
</configuration>

2.core-site.xml:

<configuration>
<property>
        <name>fs.defaultFS</name>
        <value>hdfs://node1:9000</value>
</property>
<property>
        <name>hadoop.tmp.dir</name>
        <value>/opt/hadoop-2.7.4/tmp</value>
</property>
</configuration>

3.slaves(dn节点的ip代号):

node3
node4
node5

4.hosts:

192.168.0.171 node1
192.168.0.104 node2
192.168.0.177 node3
192.168.0.158 node4
192.168.0.136 node5

5.在/etc/hadoop下:

vim masters

将node2加入到文件里边

目的是配置secondnamenode

6.这个集群的信息如下

node1:namdnode node2:secondnamenode node3-node5:datanode