http://blog.hampisoftware.com/index.php/2016/02/22/install-single-node-hadoop-on-mac/
Install Single Node Hadoop on Mac
Operating System: Mac OSX Yosemite
Hadoop Version 2.7.2
Pre-requisites
We need to enable SSH to localhost without a passphrase.
Go to System Preferences, then check “Remote Login” to ON.
Now in a terminal window, ensure that the following succeeds with no passphrase.
$>ssh localhost
Download Hadoop Distribution
Download the latest hadoop distribution from http://mirrors.ibiblio.org/apache/hadoop/common/hadoop-2.7.2/
Hadoop Configuration Files
Go to the directory where your hadoop distribution is installed.
Then change the following files
hadoop_distro/etc/hadoop/hdfs-site.xml
|
1
2
3
4
5
6
|
<
configuration
>
<
property
>
<
name
>dfs.replication</
name
>
<
value
>1</
value
>
</
property
>
</
configuration
>
|
hadoop_distro/etc/hadoop/core-site.xml
|
1
2
3
4
5
6
|
<
configuration
>
<
property
>
<
name
>fs.defaultFS</
name
>
</
property
>
</
configuration
>
|
hadoop_distro/etc/hadoop/yarn-site.xml
|
1
2
3
4
5
6
|
<
configuration
>
<
property
>
<
name
>yarn.nodemanager.aux-services</
name
>
<
value
>mapreduce_shuffle</
value
>
</
property
>
</
configuration
>
|
hadoop_distro/etc/hadoop/mapred-site.xml
|
1
2
3
4
5
6
|
<
configuration
>
<
property
>
<
name
>mapreduce.framework.name</
name
>
<
value
>yarn</
value
>
</
property
>
</
configuration
>
|
Format HDFS
$bin/hdfs namenode -format
Start HDFS
$sbin/start-dfs.sh
Start YARN
$sbin/start-yarn.sh
更多相关资料:
本文档详细介绍了如何在Mac OS X Yosemite系统上安装Hadoop 2.7.2版本,并配置为单节点模式。主要内容包括:启用SSH本地登录、下载Hadoop发行版、配置Hadoop相关文件如hdfs-site.xml、core-site.xml等,以及启动HDFS和YARN服务。
3951

被折叠的 条评论
为什么被折叠?



