安装BigTop编译的Hadoop3.1.1版本过程记录

本文记录安装编译后的rpm包的过程，主要是在不同主机上分配好需要安装的服务，使用yum命令安装，然后修改对应的配置文件，最后启动服务即可。

1、前期准备

主要包括主机的设置方面，配置主机名、IP和主机名映射、关闭防火墙等

#关闭防火墙
hostnamectl set-hostname hdp1

#修改主机名
172.16.25.139 hdp1
172.16.25.140 hdp2
172.16.25.141 hdp3
172.16.25.142 hdp4
172.16.25.143 hdp5

#关闭防火墙
systemctl stop firewalld
systemctl disable firewalld

2、配置免密码登陆

分别在hdp1、hdp2配置免密登陆

在hdp1上
cd ~
ssh-keygen -t rsa
cd .ssh
cat id_rsa.pub >> authorized_keys
scp ~/.ssh/authorized_keys hdp1:~/.ssh
scp ~/.ssh/authorized_keys hdp2:~/.ssh
scp ~/.ssh/authorized_keys hdp3:~/.ssh
scp ~/.ssh/authorized_keys hdp4:~/.ssh

在hdp2上
cd ~/.ssh
cat id_rsa.pub >> authorized_keys
scp ~/.ssh/authorized_keys hdp1:~/.ssh
scp ~/.ssh/authorized_keys hdp2:~/.ssh
scp ~/.ssh/authorized_keys hdp3:~/.ssh
scp ~/.ssh/authorized_keys hdp4:~/.ssh

3、配置JDK

每台主机分别配置

解压安装包
/opt/jdk1.8.0_131

配置环境变量，在文件/etc/profile末尾添加如下内容：
export JAVA_HOME=/opt/jdk1.8.0_131
export PATH=$PATH:$JAVA_HOME/bin

使环境变量生效
source /etc/profile

4、yum源配置、清理、缓存

配置yum源

rpm包放到下面的目录中
/var/www/html

配置hdp的repo
cat /etc/yum.repos.d/hdp.repo
[hdp]
name=hadoop
baseurl=http://172.16.25.139
enabled=1
gpgcheck=0

启动http服务
service httpd start

yum clean all
yum makecache

5、所有关于hadoop的rpm包

 yum list | grep hadoop
hadoop.x86_64                              3.1.1-1.el7                 @hdp
hadoop-hdfs.x86_64                         3.1.1-1.el7                 @hdp
hadoop-hdfs-journalnode.x86_64             3.1.1-1.el7                 @hdp
hadoop-hdfs-namenode.x86_64                3.1.1-1.el7                 @hdp
hadoop-hdfs-zkfc.x86_64                    3.1.1-1.el7                 @hdp
hadoop-hdfs-datanode.x86_64                3.1.1-1.el7                 hdp
hadoop-hdfs-fuse.x86_64                    3.1.1-1.el7                 hdp
hadoop-hdfs-secondarynamenode.x86_64       3.1.1-1.el7                 hdp
hadoop-libhdfs.x86_64                      3.1.1-1.el7                 hdp
hadoop-libhdfs-devel.x86_64                3.1.1-1.el7                 hdp


hadoop-mapreduce.x86_64                    3.1.1-1.el7                 @hdp
hadoop-mapreduce-historyserver.x86_64      3.1.1-1.el7                 @hdp

hadoop-yarn.x86_64                         3.1.1-1.el7                 @hdp
hadoop-yarn-nodemanager.x86_64             3.1.1-1.el7                 @hdp
hadoop-yarn-resourcemanager.x86_64         3.1.1-1.el7                 @hdp
hadoop-yarn-proxyserver.x86_64             3.1.1-1.el7                 hdp
hadoop-yarn-timelineserver.x86_64          3.1.1-1.el7                 hdp

hadoop-client.x86_64                       3.1.1-1.el7                 hdp
hadoop-debuginfo.x86_64                    3.1.1-1.el7                 hdp
hadoop-doc.x86_64                          3.1.1-1.el7                 hdp

hadoop-conf-pseudo.x86_64                  3.1.1-1.el7                 hdp

6、服务分配

hostname	ip	说明
hdp1<