How to use write and run MapReduce in eclipse on windows.

最新推荐文章于 2022-04-14 22:23:47 发布

弓永峰

最新推荐文章于 2022-04-14 22:23:47 发布

阅读量844

点赞数

CC 4.0 BY-SA版权

分类专栏： hadoop hbase 文章标签： Hadoop Hbase

本文链接：https://blog.youkuaiyun.com/gyflyx/article/details/8790011

hadoop 同时被 2 个专栏收录

14 篇文章

订阅专栏

hbase

6 篇文章

订阅专栏

本文档详细介绍了如何配置Hadoop与Eclipse的集成，包括将必要的JAR文件添加到类路径中，并修改了HBase的相关配置文件以解决权限设置问题。此外，还提供了针对特定错误的解决方案。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

(1) Configure hadoop-eclipse-plugin-1.0.3.jar
\\192.168.1.19\development\GroupM\Softwares\hadoop\hadoop-eclipse-plugin-1.0.3.jar
(2) copy all the jar file in the hadoop into your classpath.
(3) copy hbase\hbase-0.*.*.jar, hbase\lib\zookeeper-3.4.3.jar into your classpath.
(4) copy hbase-site.xml into your classpath.
(5) Modify org.apache.hadoop.fs.FileUtil.java

private static void checkReturnValue(boolean rv, File p,
FsPermission permission
) throws IOException {
/*if (!rv) {
throw new IOException("Failed to set permissions of path: " + p +
" to " +
String.format("%04o", permission.toShort()));
}*/
}
For this problem:
ERROR security.UserGroupInformation: PriviledgedActionException as:C5176213
cause:java.io.IOException: Failed to set permissions of path

(6) Modify hbase-site.xml in your project

Add these properties.
<property>
<name>mapred.job.tracker</name>
<value>ubuntu-api:9001</value>
</property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>

(6) copy hbase\hbase-0.*.*.jar, hbase\lib\zookeeper-3.4.3.jar to the hadoop\lib on all the
hadoop machine.