jobtracker起不来

Hadoop JobTracker权限错误解决

最新推荐文章于 2021-11-29 13:52:33 发布

原创最新推荐文章于 2021-11-29 13:52:33 发布 · 1.9k 阅读

0 ·

CC 4.0 BY-SA版权

Hadoop 专栏收录该内容

35 篇文章

订阅专栏

本文记录了一次Hadoop集群中JobTracker遇到权限问题的具体情况及解决过程。主要问题是JobTracker无法操作mapred.system.dir目录，导致启动失败。通过调整文件所有者解决了此问题。

日志：

2013-03-21 15:43:55,763 WARN org.apache.hadoop.mapred.JobTracker: Failed to operate on mapred.system.dir (hdfs://192.168.1.101:9000/home/user/hadoop/tmp/mapred/system)

because of permissions.
2013-03-21 15:43:55,763 WARN org.apache.hadoop.mapred.JobTracker: Manually delete the mapred.system.dir (hdfs://192.168.1.101:9000/home/user/hadoop/tmp/mapred/system)
and then start the JobTracker.
2013-03-21 15:43:55,765 WARN org.apache.hadoop.mapred.JobTracker: Bailing out ...
org.apache.hadoop.security.AccessControlException: The systemdir hdfs://192.168.1.101:9000/home/user/hadoop/tmp/mapred/system is not owned by user
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
        at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
2013-03-21 15:43:55,766 FATAL org.apache.hadoop.mapred.JobTracker: org.apache.hadoop.security.AccessControlException: The systemdir hdfs://192.168.1.101:9000/home/user

/hadoop/tmp/mapred/system is not owned by user

可以看出来是权限的问题，

[user@Master ~]$hadooop fs -chown -R user /home/user/hadoop/tmp/mapred

根据日志提示，修改如上，然后jobtracker启动成功