hadoop原生版安装部署---1.集群规划和准备

最新推荐文章于 2022-08-22 12:48:06 发布

jameswangcnbj

最新推荐文章于 2022-08-22 12:48:06 发布

阅读量387

点赞数

CC 4.0 BY-SA版权

分类专栏： hadoop 文章标签： hadoop

本文链接：https://blog.youkuaiyun.com/jameswangcnbj/article/details/55208796

hadoop 专栏收录该内容

10 篇文章

订阅专栏

本系列文章在centos6.6 64位系统上安装hadoop2.2.0测试通过，虚拟机内存8G disk200G cpu：逻辑4核

1.集群规划

主机	安装软件	进程
c9test91	jdk hadoop zk	NameNode、DFSZKFailoverController、JournalNode、QuorumPeerMain
c9test92	jdk hadoop zk	NameNode、DFSZKFailoverController、JournalNode、QuorumPeerMain
c9test93	jdk hadoop zk	DataNode、NodeManager、JournalNode、QuorumPeerMain 、ResourceManager
c9test94	jdk hadoop	DataNode、NodeManager

准备阶段的下面的内容需要在4台机器上执行。

2.安装jdk1.6.0.45

http://www.oracle.com/technetwork/java/javasebusiness/downloads/java-archive-downloads-javase6-419409.html#jdk-6u45-oth-JPR

3.hosts

vi /etc/hosts
192.168.209.91  c9test91
192.168.209.92  c9test92
192.168.209.93  c9test93
192.168.209.94  c9test94

4.创建组和用户

groupadd hadoop
useradd -m -g hadoop hadoop
passwd hadoop   

visudo(vi /etc/sudoers) 增加hadoop用户,只在NN

5.配置hadoop用户间的无密码访问

su - hadoop
ssh-keygen -t rsa -P '' (所有机器执行)
//在一台机器如91上执行
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
ssh hadoop@c9test92 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
ssh hadoop@c9test93 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
ssh hadoop@c9test94 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

scp ~/.ssh/authorized_keys hadoop@c9test92:~/.ssh/authorized_keys
scp ~/.ssh/authorized_keys hadoop@c9test93:~/.ssh/authorized_keys
scp ~/.ssh/authorized_keys hadoop@c9test94:~/.ssh/authorized_keys

//注意：chmod 600 ~/.ssh/authorized_keys 否则不生效

6.管理防火墙和selinux

service iptables stop
chkconfig iptables off