CDH安装文档

参考文档：http://www.cloudera.com/content/www/en-us/documentation/enterprise/latest/topics/cm_ig_install_path_b.html#concept_qwc_xcc_yr_unique_1

1、卸载openjdk
先查看 rpm -qa | grep java
显示如下信息：
java-1.4.2-gcj-compat-1.4.2.0-40jpp.115
java-1.6.0-openjdk-1.6.0.0-1.7.b09.el5
卸载：
rpm -e --nodeps java-1.4.2-gcj-compat-1.4.2.0-40jpp.115
rpm -e --nodeps java-1.6.0-openjdk-1.6.0.0-1.7.b09.el5

2、安装jdk8

安装jdk：yum install oracle-j2sdk1.7

3、修改hosts
vi /etc/sysconfig/network
vi /etc/hosts
10.160.33.21 master-001.ymm.com master-001
10.117.24.248 master-002.ymm.com master-002
10.160.11.134 master-003.ymm.com master-003
10.252.113.105 slave-001.ymm.com slave-001
10.51.22.132 slave-002.ymm.com slave-002
10.132.70.20 slave-003.ymm.com slave-003

hostname resource-001.ymm.com resource-001
/etc/init.d/network restart
service nscd restart

------------------------------
4、关闭防火墙
chkconfig iptables off
service iptables stop
chkconfig iptables --list

5、修改SELINUX
vim /etc/selinux/config
SELINUX=disabled

6、配置ssh

7.安装python2.7

8、修改安装源
all node
vi /etc/yum.repos.d/myrepo.repo
[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
#baseurl=http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5/
baseurl=http://10.168.12.72/5.4.6/
gpgkey = http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera
gpgcheck = 1

9、安装mysql

创建相关数据库,并授权

create database amon DEFAULT CHARACTER SET utf8;

create database rman DEFAULT CHARACTER SET utf8;

create database metastore DEFAULT CHARACTER SET utf8;

create database sentry DEFAULT CHARACTER SET utf8;

create database nav DEFAULT CHARACTER SET utf8;

create database navms DEFAULT CHARACTER SET utf8;

create database oozie DEFAULT CHARACTER SET utf8;

grant all on amon.* to 'amon'@'%' IDENTIFIED BY '*******';

grant all on rmon.* to 'rmon'@'%' IDENTIFIED BY '*******';

grant all on metastore.* to 'hive'@'%' IDENTIFIED BY '*******';

grant all on sentry.* to 'sentry'@'%' IDENTIFIED BY '*******';

grant all on nav.* to 'nav'@'%' IDENTIFIED BY '*******';

grant all on navms.* to 'navms'@'%' IDENTIFIED BY '*******';

grant all privileges on oozie.* to 'oozie'@'localhost' identified by '*******';

grant all privileges on oozie.* to 'oozie'@'%' identified by '*******';

grant all on amon.* to 'amon'@'localhost' IDENTIFIED BY '*******';

grant all on rmon.* to 'rmon'@'localhost' IDENTIFIED BY '*******';

grant all on metastore.* to 'hive'@'localhost' IDENTIFIED BY '*******';

grant all on sentry.* to 'sentry'@'localhost' IDENTIFIED BY '*******';

grant all on nav.* to 'nav'@'localhost' IDENTIFIED BY '*******';

grant all on navms.* to 'navms'@'localhost' IDENTIFIED BY '*******';

grant all on amon.* to 'amon'@' lmaster-001.ymm.com' IDENTIFIED BY '*******';

grant all on rmon.* to 'rmon'@' master-001.ymm.com' IDENTIFIED BY '*******';

grant all on metastore.* to 'hive'@' master-001.ymm.com' IDENTIFIED BY '*******';

grant all on sentry.* to 'sentry'@' master-001.ymm.com' IDENTIFIED BY '*******';

grant all on nav.* to 'nav'@' master-001.ymm.com' IDENTIFIED BY '*******';

grant all on navms.* to 'navms'@' master-001.ymm.com' IDENTIFIED BY '*******';

grant all on oozie.* to 'oozie'@'localhost' IDENTIFIED BY '*******';

grant all on oozie.* to 'oozie'@' master-001.ymm.com' IDENTIFIED BY '*******';

10、安装cloudera-manager
sudo yum install cloudera-manager-daemons cloudera-manager-server

11、启动SCM-Server
service cloudera-scm-server start
日志：tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

12、下载parcels
parcels下载不下来，离线下载parcels
http://archive-primary.cloudera.com/cdh5/parcels/5.4.9.19/
替换至目录：/opt/cloudera/parcel-repo
识别不出parcels可能要重启server和agent

13、更改 /proc/sys/vm/swappiness值
sysctl vm.swappiness=0
vi /etc/sysctl.conf 在最后添加一行：vm.swappiness=0

14、禁用”透明大页面“
echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
vi /etc/rc.local
echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag

15、配置NTP
vi /etc/ntp.conf #添加server
chkconfig ntpd on
service ntpd start
ntpdate -u <your_ntp_server>
hwclock --systohc

1、下载安装包，搭建本地源

1）安装httpd : yum install httpd

2) 启动httpd：

service httpd status   查看服务状态

service httpd start     启动Apache HTTP服务

service httpd stop     关闭Apache HTTP服务

service httpd restart 重启Apache HTTP服务

3）设置开机启动：chkconfig httpd on

4）修改yum源： vim /etc/yum.repos.d/cloudera-install.repo

5） 安装包放到httpd目录：/var/www/html/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64

安装包在下列网站下载

>网站

     http://archive.cloudera.com/cm5/

    >cm-5.3.6 bin 文件

     http://archive.cloudera.com/cm5/installer/5.3.6/cloudera-manager-installer.bin

    >cm-5.3.6依赖的rpm包（7个rpm包）

     http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/

     http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/RPMS/x86_64/

6） 安装postgresq

cd /opt/software/postgresq/

rpm -ivh *.rpm

7)安装repo源

cd /opt/software/repo

rpm -ivh deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm

rpm -ivh python-deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm

rpm -ivh createrepo-0.9.8-5.el6.noarch.rpm

8)创建repodata文件夹（手动创建yum源）

cd /var/www/html/cm5/redhat/6/x86_64/cm/5/

createrepo .

9）验证yum源是否成功

2、安装CM

1）执行安装程序

cd /opt/software/cm_bin/

./cloudera-manager-installer.bin

出错看日志

2）hadoop安装包 下载位置 /opt/cloudera