MapReduce Streaming Python AWS 30分钟 (3)

M3+ubuntu的镜像在mac上不知为何总崩溃，换回CentOS+CDH的组合继续，安装顺序如下。

1.CentOS 6.0

2.JAVA JDK

>Linux x86 - RPM Installer<

[root@localhost tmp]# chmod 777 jdk-xxxx-linux-xxxx-rpm.bin [root@localhost tmp]# ./jdk-xxxx-linux-xxxx-rpm.bin [root@localhost tmp]# java -version java version "1.6.xxxx" Java(TM) SE Runtime Environment (build 1.6.xxxx) Java HotSpot(TM) Client VM (build xxxx, mixed mode, sharing)

ln -s /usr/java/latest/ /usr/local/java 

ln -s /usr/lib/hadoop-0.20/ hadoop

3.Hadoop

http://d.hatena.ne.jp/wyukawa/20110614/1308066200

root@localhost ~]# curl http://archive.cloudera.com/redhat/cdh/cloudera-cdh3.repo > /etc/yum.repos.d/cloudera-cdh3.repo [root@localhost ~]# yum install hadoop-0.20-conf-pseudo

cd /usr/local

ln -s  /usr/lib/hadoop-0.20 hadoop

export HADOOP=/usr/local/hadoop

export HADOOP_BIN=/usr/local/hadoop/bin

4修改启动文件

/etc/bashrc

export HADOOP=/usr/local/hadoop export HADOOP_HOME=/usr/local/hadoop export HADOOP_BIN=/usr/local/hadoop/bin export HADOOP_CONF_DIR=/usr/local/hadoop/conf export JAVA_HOME=/usr/java/jdk***** export PATH=$JAVA_HOME/bin:$PATH

5.到/etc/init.d/hadoop相关的5个服务全部启动

http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH3/CDH3u6/CDH3-Quick-Start/cdh3qs_topic_3_2.html

6.hadoop dfs -mkdir hello_world 

完成。