windows hadoop issue

1:

在hadoop安装目录下，运行运行命令

bin/hadoop fs -put /home/files/* /input 

报错，提示

put: File /home/files/ does not exist.

由于 Cygwin 的路径并无法正常被 Hadoop 解析，亦即 Hadoop 经过 Windows OS 告知路径为 C:\...\files\ 但在 Cygwin 中却为 \...\files

因此倘若您看到 File XXXX does not exist 的问题，可用 cygpath -w 指令把路径转变成 Windows 绝对路径，就可以解决，运行

bin/hadoop fs -put $(cygpath -w /cygdrive/d/cygwin/home/files/*) /input

拷贝成功。

2

Win下Eclipse提交hadoop程序出错：org.apache.hadoop.security.AccessControlException: Permission denied: user=DrWho, access=WRITE

solution: 到服务器上修改hadoop的配置文件：conf/hdfs-core.xml, 找到 dfs.permissions 的配置项 , 将value值改为 false

<property>
<name>dfs.permissions</name>
<value>false</value>
<description>
If "true", enable permission checking in HDFS.
If "false", permission checking is turned off,
but all other behavior is unchanged.
Switching from one parameter value to the other does not change the mode,
owner or group of files or directories.
</description>
</property>