折腾了挺久时间,把hadoop装好,简单记录下
注意事项:
1、测试时三台机器防火墙都关闭2、我这使用的是root帐号,如果非root帐号注意权限
3、mapred.xml.默认不存在,cp mapred-site.xml.template mapred-site.xml
4、hadoop配置文件使用配置好的主机名
IP地址 主机名 用途
192.168.20.197 hd1 namenode
192.168.20.193 hd2 datanode
192.168.20.195 hd3 datanode
一、系统设置
(所有步骤都需要在所有节点执行)
1. 修改主机名及ip地址解析
1) 修改主机名
# hostname hd1
# cat /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=hd1
2) 增加ip和主机映射
# vi /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.20.197 hd1
192.168.20.193 hd2
192.168.20.195 hd3
3) 验证是否成功
[root@hd1 ~]# ping hd2
PING hd2 (192.168.20.193) 56(84) bytes of data.
64 bytes from hd2 (192.168.20.193): icmp_seq=1 ttl=64 time=0.721 ms
64 bytes from hd2 (192.168.20.193): icmp_seq=1 ttl=63 time=1.25 ms (DUP!)
64 bytes from hd2 (192.168.20.193): icmp_seq=1 ttl=64 time=1.53 ms (DUP!)
64 bytes from hd2 (192.168.20.193): icmp_seq=1 ttl=63 time=2.79 ms (DUP!)
[root@hd1 ~]# ping hd3
PING hd3 (192.168.20.195) 56(84) bytes of data.
64 bytes from hd3 (192.168.20.195): icmp_seq=1 ttl=64 time=1.88 ms
64 bytes from hd3 (192.168.20.195): icmp_seq=1 ttl=63 time=2.18 ms (DUP!)
64 bytes from hd3 (192.168.20.195): icmp_seq=1 ttl=64 time=2.19 ms (DUP!)
64 bytes from hd3 (192.168.20.195): icmp_seq=1 ttl=63 time=2.19 ms (DUP!)
能ping通说明已经OK。
2. 关闭防火墙
# chkconfig iptables off
3. SSH免密码登陆可参考我另外文章: http://blog.youkuaiyun.com/nuli888/article/details/51924390
1) 生成密钥与公钥 登陆到hd1,把生成的id_rsa.pub(公钥)内容cat到authorized_keys文件中。同时登陆到hd2, hd3,生成id_rsa.pubÿ