开发平台搭建:
jdk
cygwin
需要安装的组件有:
net :openssl openssh ;
editors:vim;
devel:subversion
2
c:/cygwin/bin;c:/cygwin/usr/bin
C:\cygwin\bin;c:\cygwin\usr\sbin;
CYGWIN ntsec
3ssh-host-config守护进程 启动sshd
4 Setup authorization keys
ssh-keygen 3enter
cd ~/.ssh
ls -l
cat id_rsa.pub >> authorized_keys
ssh localhost yes enter
ssh localhost
5 hadoop 下载到C:\cygwin\home\hhp
tar -xzf hadoop-0.19.1.tar.gz 解压缩
6配置hadoop-0.19.1/conf/hadoop-site.xml
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9100</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>localhost:9101</value>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
-------------2.0----------------
/cygdrive/d/java/jdk1.6.0_13 hadoop-env.sh
core-site.xml
fs.default.name
hdfs://localhost:9000
hdfs-site.xml
mapred-site.xml
mapred.job.tracker
localhost:9001
7 Format the namenode
cd hadoop-0.19.1
mkdir logs
bin/hadoop namenode -format
运行:进入hadoop运行bin/start-all.sh
8将插件放入eclipse中
9Start the local hadoop cluster ,建立hadoop server ,上传
9新建hadoop项目,建立hadoop server,运行hadoop项目
hadoop
下载hadoop,解压缩,编辑一些配置文件jdk路径 等
启动hadoop集群:
伪分布式模式:
配置hadoop-site。xml
免密码ssh设置
执行:1格式化一个新的分布式文件系统
2启动hadoop守护进程 start-all.sh
1配置hadoop的运行环境
2配置hadoop的开发环境\
看看ibm的搜索hadoop
jdk
cygwin
需要安装的组件有:
net :openssl openssh ;
editors:vim;
devel:subversion
2
c:/cygwin/bin;c:/cygwin/usr/bin
C:\cygwin\bin;c:\cygwin\usr\sbin;
CYGWIN ntsec
3ssh-host-config守护进程 启动sshd
4 Setup authorization keys
ssh-keygen 3enter
cd ~/.ssh
ls -l
cat id_rsa.pub >> authorized_keys
ssh localhost yes enter
ssh localhost
5 hadoop 下载到C:\cygwin\home\hhp
tar -xzf hadoop-0.19.1.tar.gz 解压缩
6配置hadoop-0.19.1/conf/hadoop-site.xml
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9100</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>localhost:9101</value>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
-------------2.0----------------
/cygdrive/d/java/jdk1.6.0_13 hadoop-env.sh
core-site.xml
fs.default.name
hdfs://localhost:9000
hdfs-site.xml
mapred-site.xml
mapred.job.tracker
localhost:9001
7 Format the namenode
cd hadoop-0.19.1
mkdir logs
bin/hadoop namenode -format
运行:进入hadoop运行bin/start-all.sh
8将插件放入eclipse中
9Start the local hadoop cluster ,建立hadoop server ,上传
9新建hadoop项目,建立hadoop server,运行hadoop项目
hadoop
下载hadoop,解压缩,编辑一些配置文件jdk路径 等
启动hadoop集群:
伪分布式模式:
配置hadoop-site。xml
免密码ssh设置
执行:1格式化一个新的分布式文件系统
2启动hadoop守护进程 start-all.sh
1配置hadoop的运行环境
2配置hadoop的开发环境\
看看ibm的搜索hadoop