CDH5.9自动安装批处理

最新推荐文章于 2023-09-12 12:05:06 发布

it_mann

最新推荐文章于 2023-09-12 12:05:06 发布

阅读量317

点赞数

CC 4.0 BY-SA版权

分类专栏： 1 文章标签： cdh

本文链接：https://blog.youkuaiyun.com/it_mann/article/details/81612493

1 专栏收录该内容

3 篇文章

订阅专栏

本文档详细介绍了如何在CentOS 7上配置Cloudera集群，包括设置yum源、安装JDK、配置hosts文件、安装MySQL客户端及SCM-Agent等步骤，并特别针对SCM-Server节点讲解了cloudera-scm-server的安装与MySQL服务端的配置。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

#一、所有节点执行：
#配置yum源、安装wget
cp -R /etc/yum.repos.d /etc/yum.repos.d.bak
rm -rf /etc/yum.repos.d/*
cat >>/etc/yum.repos.d/Centos7-Ali.repo<<OVER
[base]
name=CentOS-\$releasever - Base - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/\$releasever/os/\$basearch/
gpgcheck=1
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-7
OVER
yum clean all

#安装jdk
rpm -qa|grep openjdk|xargs yum -y remove
ls /tmp/*.rpm|grep oracle |xargs rpm -ivh
ls -d /usr/java/jdk*-cloudera|xargs -i echo 'export JAVA_HOME={}' >> /etc/profile
echo 'export PATH=$JAVA_HOME/bin:$PATH' >> /etc/profile
echo 'export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar' >> /etc/profile
source /etc/profile

#配置hosts文件
cat>>/etc/hosts<<Over
192.168.1.11 cdh1
192.168.1.12 cdh2
192.168.1.13 cdh3
192.168.1.14 cdh4
192.168.1.15 cm
Over

#安装MySql客户端
yum remove mariadb-libs -y
ls /tmp/mysql*.rpm|grep -v server |xargs yum -y install mysql-connector-java.noarch

#安装SCM-Agent
ls /tmp/cloudera*.rpm|grep -v server|xargs yum -y install
sed -i s/server_host=localhost/server_host=youe.cm/g /etc/cloudera-scm-agent/config.ini

systemctl start cloudera-scm-agent

#二、SCM-Server节点执行：
#安装cloudera-scm-server
yum remove mariadb-libs -y
ls /tmp/cloudera-*|grep server|xargs yum -y install

#安装MySql服务端
ls /tmp/mysql*|grep server|xargs rpm -ivh
启动mysql
systemctl start mysqld.service
配置mysql授权
grep password /var/log/mysqld.log|head -n 1|cut -d ':' -f 4|xargs -t -i echo -e "[client]\nuser=root\npassword='{}'">~/.my.cnf
mysql
set password=password('admin');
创建数据库、用户并授权
CREATE USER 'hive'@'%' IDENTIFIED BY 'abc';
GRANT ALL PRIVILEGES ON Hive.* TO 'hive'@'%' IDENTIFIED BY 'abc';
quit;
sed -i /password/d ~/.my.cnf
echo "password='admin'">>~/.my.cnf

/usr/share/cmf/schema/scm_prepare_database.sh mysql -h ip SCM root admin
#拷贝parcel文件到：/opt/cloudera/parcel-repo目录下（含parcel、sha、json三个文件）
systemctl restart cloudera-scm-server
tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

#安装脚本运行完成，打开网页IP:7180 admin:admin