centos7安装hadoop1.2.1分布式集群

最新推荐文章于 2025-01-12 12:52:17 发布

原创最新推荐文章于 2025-01-12 12:52:17 发布 · 607 阅读

0 ·

CC 4.0 BY-SA版权

Hadoop 专栏收录该内容

3 篇文章

订阅专栏

本文详细介绍了Hadoop集群的搭建过程，包括主机名与hosts文件的配置、SSH免密登录设置、JDK安装、Hadoop配置及环境变量设定等关键步骤，并提供了启动与测试Hadoop集群的方法。

一、更改主机名

hostnamectl
hostnamectl －－static set-hostname hadoop-01

二、更改hosts

vi /etc/hosts

三、免验证ssh登录

rm -rf .ssh
ssh-keygen -t rsa

scp root@202.193.74.110:/root/.ssh/id_rsa.pub ./1.pub
scp root@202.193.74.178:/root/.ssh/id_rsa.pub ./2.pub
scp root@202.193.75.178:/root/.ssh/id_rsa.pub ./3.pub

cat id_rsa.pub >> authorized_keys
cat 1.pub >> authorized_keys
cat 2.pub >> authorized_keys
cat 3.pub >> authorized_keys

四、安装jdk

rpm -ivh jdk*

五、配置hadoop

http://hadoop.apache.org/docs/r1.2.1/single_node_setup.html
http://hadoop.apache.org/docs/r1.2.1/cluster_setup.html

六、配置环境变量

vi /etc/profile

export JAVA_HOME=/usr/java/jdk1.7.0_71/
export JRE_HOME=$JAVA_HOME/jre
export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib:$JRE_HOME/lib
export HADOOP_HOME=/root/Desktop/hadoop-1.2.1/
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin

source /etc/profile

七、关闭防火墙

systemctl stop firewalld.service #停止firewall
systemctl disable firewalld.service #禁止firewall开机启动

八、启动hadoop
hadoop namenode -format
start-all.sh
hadoop fs -mkdir test
hadoop dfsadmin -report
stop-all.sh