测试集群模式安装实施Hadoop

测试集群模式安装实施Hadoop   

1. 集群架构

 

在VMware中安装三台CentOS虚拟机server1，server2，server3，其中server1作为Hadoop集群的NomeNode和JobTracker，server2和server3作为DataNode和TaskTracker.  为简便将DNS、NFS也安装在server1之上。

 

2.安装DNS

 

使用yum安装bind

[root@server1 admin]#  yum install bind*

 

安装完成后检查，

[root@server1 admin]#  rpm -qa | grep  '^bind'

bind-dyndb-ldap-1.1.0-0.9.b1.el6_3.1.x86_64

bind-chroot-9.8.2-0.10.rc1.el6_3.6.x86_64

bind-libs-9.8.2-0.10.rc1.el6_3.6.x86_64

bind-sdb-9.8.2-0.10.rc1.el6_3.6.x86_64

bind-utils-9.8.2-0.10.rc1.el6_3.6.x86_64

bind-devel-9.8.2-0.10.rc1.el6_3.6.x86_64

bind-9.8.2-0.10.rc1.el6_3.6.x86_64

 

安装已经齐全

 

修改配置文件

修改/etc/named.conf，将127.0.0.1,localhost 改成any

[root@server1 etc]# vim named.conf

 

options {

        listen-on port 53 { any; };

        listen-on-v6 port 53 { ::1; };

        directory       "/var/named";

        dump-file       "/var/named/data/cache_dump.db";

        statistics-file "/var/named/data/named_stats.txt";

        memstatistics-file "/var/named/data/named_mem_stats.txt";

        allow-query     { any; };

        recursion yes;

 

        dnssec-enable yes;

        dnssec-validation yes;

        dnssec-lookaside auto;

 

        

        bindkeys-file "/etc/named.iscdlv.key";

        managed-keys-directory "/var/named/dynamic";

};

 

修改/etc/named.rfc1912.zones, 加入以下内容

zone "myhadoop.com" IN {

        type master;

        file "myhadoop.com.zone";       

        allow-update { none; };

};

zone "1.168.192.in-addr.arpa" IN {

        type master;

        file "1.168.192.in-addr.zone";

        allow-update { none; };

};

 

在目录/var/named下创建文件myhadoop.com.zone、1.168.192.in-addr.zone

 

修改myhadoop.com.zone为

 

$TTL 86400

@     IN SOA     server1.myhadoop.com. chizk.root.myhadoop.com. (

                                              0       ; serial (d.adams)

                                               1D    ; refresh

                                               1H    ; retry

                                               1W   ; expire

                                               3H )  ; minimum

@     IN NS  server1.myhadoop.com.

server1.myhadoop.com.       IN A 192.168.1.201

server2.myhadoop.com.   IN A 192.168.1.202

server3.myhadoop.com.   IN A 192.168.1.203

 

修改1.168.192.in-addr.zone为

$TTL 86400

@     IN SOA  server1.myhadoop.com. chizk.root.myhadoop.com. (

                                        0       ; serial

                                        1D      ; refresh

                                        1H      ; retry

                                        1W      ; expire

                                        3H )    ; minimum

@       IN NS  server1.myhadoop.com.

201     IN PTR server1.myhadoop.com.   

202     IN PTR server2.myhadoop.com.   

202     IN PTR server3.myhadoop.com.

修改这两个文件的所有者

 

[root@server1 named]# chown root.named myhadoop.com.zone

[root@server1 named]# chown root.named 1.168.192.in-addr.zone

 

在/etc/resolv.conf中添加以下配置

nameserver 192.168.1.201

 

用同样的方法修改server2、server3中的/etc/resolv.conf文件

 

启动DNS

[root@server1 named]# service named start

Starting named:                                            [  OK  ]

 

设置为开机自动启动

[root@server1 admin]# chkconfig named on

 

测试DNS查询

[root@server1 admin]# nslookup server1.myhadoop.com

Server:               192.168.1.201

Address:  192.168.1.201#53

 

Name:      server1.myhadoop.com

Address: 192.168.1.201

 

[root@server1 admin]# nslookup server2.myhadoop.com

Server:               192.168.1.201

Address:  192.168.1.201#53

 

Name:      server2.myhadoop.com

Address: 192.168.1.202

 

[root@server1 admin]# nslookup server3.myhadoop.com

Server:               192.168.1.201

Address:  192.168.1.201#53

 

Name:      server3.myhadoop.com

Address: 192.168.1.203

 

查询成功，同时在server2，server3中测试，查询都成功

 

3.安装NFS

 

查看NFS和rpcbind包是否已安装

 

[root@server1 admin]# rpm -qa | grep nfs

nfs4-acl-tools-0.3.3-5.el6.x86_64

nfs-utils-1.2.2-7.el6.x86_64

nfs-utils-lib-1.1.5-1.el6.x86_64

[root@server1 admin]# rpm -qa | grep rpcbind

rpcbind-0.2.0-8.el6.x86_64

 

可见已经安装完全，若没有安装使用yum安装即可。

 

修改文件/etc/exports, 加入以下内容

/home/admin *(sync,rw)

 

启动NFS

[root@server1 admin]# service nfs start

Starting NFS services:                                     [  OK  ]

Starting NFS quotas:                                       [  OK  ]

Starting NFS daemon:                                       [  OK  ]

Starting NFS mountd:                                       [  OK  ]

 

设置为开机自动启动

[root@server1 admin]# chkconfig nfs on

 

启动rpcbind

[root@server1 admin]# service rpcbind start

Starting rpcbind:                                          [  OK  ]

 

设置为自动启动

[root@server1 admin]# chkconfig rpcbind on

 

输出挂载点

[root@server1 admin]# showmount -e localhost

Export list for localhost:

/home/admin *

 

修改/home/admin的权限，为方便设置为777

[root@server1 home]# chmod 777 /home/admin

 

在server2中挂载server1中的/home/admin

 

[root@server2 home]# mount server1.myhadoop.com:/home/admin/ /home/admin_share/

 

测试访问

[root@server2 home]# cd admin_share/

[root@server2 admin_share]# cat test.txt

aaaa,111

bbbb,222

cccc,333

dddd,444

可见访问成功

 

修改server2的/etc/fstab 文件，设置自动挂载，在末尾添加如下行：

server1.myhadoop.com:/home/admin   /home/admin_share   nfs  defaults 1 1

 

同理在server3中挂载server1的/home/admin，并测试

 

 

4. 共享密钥文件

 

为server1，server2，server3的admin用户各自生成登录密钥

[admin@server1 ~]$ ssh-keygen -t rsa

Generating public/private rsa key pair.

Enter file in which to save the key (/home/admin/.ssh/id_rsa):

/home/admin/.ssh/id_rsa already exists.

Overwrite (y/n)? y

Enter passphrase (empty for no passphrase):

Enter same passphrase again:

Your identification has been saved in /home/admin/.ssh/id_rsa.

Your public key has been saved in /home/admin/.ssh/id_rsa.pub.

The key fingerprint is:

46:56:64:8f:83:13:e0:f3:17:cb:b9:7d:d5:fc:9f:52 admin@server1

The key's randomart image is:

+--[ RSA 2048]----+

|      ....+      |

|     .   = o     |

|      o = + .    |

|       = o =   ..|

|        S =     +|

|       . . o   E.|

|          . . o .|

|             o  o|

|              ...|

+-----------------+

[admin@server2 ~]$ ssh-keygen -t rsa

[admin@server3 ~]$ ssh-keygen -t rsa

 

在server1中将id_rsa.pub 复制为authorized_keys

[admin@server1 ~]$ cp .ssh/id_rsa.pub .ssh/authorized_keys

 

 在server2，server3中建立共享密钥到本地的软连接

[admin@server2 ~]$ ln -s /home/admin_share/.ssh/authorized_keys ~/.ssh/authorized_keys

[admin@server3 ~]$ ln -s /home/admin_share/.ssh/authorized_keys ~/.ssh/authorized_keys

 

将server2，server3的密钥分别追加到authorized_keys

[admin@server2 ~]$ cat .ssh/id_rsa.pub >> .ssh/authorized_keys

[admin@server3 ~]$ cat .ssh/id_rsa.pub >> .ssh/authorized_keys

 

测试配置

[admin@server1 ~]$ ssh server1.myhadoop.com

The authenticity of host 'server1.myhadoop.com (192.168.1.201)' can't be established.

RSA key fingerprint is a9:f3:7f:55:56:3a:a7:d7:9e:23:1e:86:a5:eb:90:dc.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'server1.myhadoop.com,192.168.1.201' (RSA) to the list of known hosts.

Last login: Sun Jan 27 10:02:12 2013 from server1

 

同样方法测试其他机器，测试成功

 

 

5. 安装Hadoop

在server1上，hadoop中配置core-site.xml 为以下格式：

 

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

 

<!-- Put site-specific property overrides in this file. -->

 

<configuration>

   <property>

      <name>fs.default.name</name>

      <value>hdfs://server1.myhadoop.com:9000</value>

   </property>

</configuration>

 

配置mapred-site.xml:

 

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

 

<!-- Put site-specific property overrides in this file. -->

 

<configuration>

  <property>

    <name>mapred.job.tracker</name>

    <value>server1.myhadoop.com:9001</value>

  </property>

 <property>

     <name>mapred.job.tracker.map.tasks.maximum</name>

     <value>50</value>

 </property>

<property>

     <name>mapred.job.tracker.reduce.tasks.maximum</name>

     <value>50</value>

 </property>

</configuration>

 

配置master为

server1.myhadoop.com

 

配置slaves为

server2.myhadoop.com

server3.myhadoop.com

 

建立文本文件serverlist.txt，里面包含所有需要分发Hadoop的机器域名，在这里为server2，server3，即内容为

[admin@server1 ~]$ cat serverlist.txt

server2.myhadoop.com

server3.myhadoop.com

 

生成Hadoop的Shell脚本

[admin@server1 ~]$ cat serverlist.txt | awk '{print "scp -rp /home/admin/hadoop-0.20.2/ admin@"$1":/home/admin/"}' > distributeHadoop.sh

 

内容如下

[admin@server1 ~]$ cat ./distributeHadoop.sh

scp -rp /home/admin/hadoop-0.20.2/ admin@server2.myhadoop.com:/home/admin/

scp -rp /home/admin/hadoop-0.20.2/ admin@server3.myhadoop.com:/home/admin/

 

运行脚本

[admin@server1 ~]$ ./distributeHadoop.sh

 

检查server2 、server3，复制成功

 

格式化namenode

[admin@server1 logs]$ hadoop namenode -format

 

启动Hadoop

[admin@server1 ~]$ ./hadoop-0.20.2/bin/start-all.sh

 

starting namenode, logging to /home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-namenode-server1.out

server2.myhadoop.com: starting datanode, logging to /home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-datanode-server2.out

server3.myhadoop.com: starting datanode, logging to /home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-datanode-server3.out

server1.myhadoop.com: starting secondarynamenode, logging to /home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-secondarynamenode-server1.out

starting jobtracker, logging to /home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-jobtracker-server1.out

server2.myhadoop.com: starting tasktracker, logging to /home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-tasktracker-server2.out

server3.myhadoop.com: starting tasktracker, logging to /home/admin/hadoop-0.20.2/bin/../logs/hadoop-admin-tasktracker-server3.out

 

 

检查server1、server2、server3，启动成功

[admin@server1 logs]$ jps

6481 NameNode

6612 SecondaryNameNode

6681 JobTracker

6749 Jps

 

[admin@server2 logs]$ jps

14869 TaskTracker

14917 Jps

14795 DataNode

 

[admin@server3 logs]$ jps

16354 TaskTracker

16396 Jps

16280 DataNode