HA集群安装
硬件准备
七台虚拟机、配置好hosts、免密登录等。
hadoop1 192.168.56.101 jdk、hadoop NameNode、DFSZKFailoverController(zkfc)
hadoop2 192.168.56.102 jdk、hadoop NameNode、DFSZKFailoverController(zkfc)
hadoop3 192.168.56.103 jdk、hadoop ResourceManager
hadoop4 192.168.56.104 jdk、hadoop ResourceManager
hadoop5 192.168.56.105 jdk、hadoop、zookeeper DataNode、NodeManager、JournalNode、QuorumPeerMain
hadoop6 192.168.56.106 jdk、hadoop、zookeeper DataNode、NodeManager、JournalNode、QuorumPeerMain
hadoop7 192.168.56.107 jdk、hadoop、zookeeper DataNode、NodeManager、JournalNode、QuorumPeerMain
安装jdk
jdk安装过程不再介绍
安装zookeerper
请看 zookeerper安装
安装hadoop
上传、解压
修改core-site.xml文件
<configuration>
<!-- 指定hdfs的nameservice为ns1 -->
<property>
<name>fs.defaultFS</name>
<value>hdfs://bi/</value>
</property>
<!-- 指定hadoop临时目录 -->
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/data/hdpdata/</value>
</property>
<!-- 指定zookeeper地址 -->
<property>
<name>ha.zookeeper.quorum</name>
<value>hadoop5:2181,hadoop6:2181,hadoop7:2181</value>
</property>
</configuration>
修改mapred-site.xml
<configuration>
<!-- 指定mr框架为yarn方式 -->
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
修改yarn-site.xml
<configuration>
<!-- 开启RM高可用 -->
<property>