Hadoop伪分布式集群部署

1、下载Hadoop安装包hadoop-2.7.0.tar.gz

2、用命令进入放置目录，解压，tar xzvf hadoop-2.7.0.tar.gz

解压会打印出明细信息，中间信息略.......

解压完成

3、配置hadoop环境变量/myFile/04.BigData/hadoop-2.7.0/etc/hadoop/hadoop-env.sh

export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_111.jdk/Contents/Home

export HADOOP_PREFIX=/myFile/04.BigData/hadoop-2.7.0

4、修改配置文件

/myFile/04.BigData/hadoop-2.7.0/etc/hadoop/core-site.xml

<configuration>

<property>

<name>fs.default.name</name>

<value>hdfs://localhost:9000</value>

</property>

</configuration>

/myFile/04.BigData/hadoop-2.7.0/etc/hadoop/hdfs-site.xml

<configuration>

<property>

<name>dfs.replication</name>

<value>1</value>

</property>

</configuration>

没有mapred-site.xml文件，我们拷贝一份mapred-site.xml.template

/myFile/04.BigData/hadoop-2.7.0/etc/hadoop/mapred-site.xml

<configuration>

<property>

<name>mapred.job.tracker</name>

<value>localhost:9001</value>

</property>

</configuration>

5、修改系统环境变量，保证OS、java、hadoop都是32位或者都是64位。

修改配置文件

执行source命令使配置生效

zhaojunyandeMacBook-Pro:~ zhaojunyan$ source /etc/profile 

6、运行sbin/start-all.sh，查看进程

zhaojunyandeMacBook-Pro:~ zhaojunyan$ jps

55905 NameNode

68864 NodeManager

68786 ResourceManager

49829 DataNode

49919 SecondaryNameNode

76830 Jps

zhaojunyandeMacBook-Pro:~ zhaojunyan$