Java org.apache.hadoop.security.AccessControlException: Permission denied

最新推荐文章于 2022-08-14 15:38:38 发布

禾火r

最新推荐文章于 2022-08-14 15:38:38 发布

阅读量362

点赞数

CC 4.0 BY-SA版权

文章标签： mapreduce hdfs hadoop

本文链接：https://blog.youkuaiyun.com/weixin_47702002/article/details/106675663

本文详细记录了在Eclipse环境下运行Hadoop WordCount程序时遇到的权限不足错误，并提供了具体的解决方案，包括如何在HDFS上修改文件权限。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

在eclipse中运行Hadoop的worldcount程序时报如下错误：

org.apache.hadoop.security.AccessControlException:Permission denied: user=????, access=WRITE, inode="/456
/output/_temporary/0":root:supergroup:drwxr----x

说没有权限，在shell/虚拟机端给它权限即可：

hdfs dfs -chmod 777 /users

/users

是在hdfs上的文件，需要指定你要操作的文件/目录的名称
以下是部分报错（较全，可以比较下是否报错相同）

2020-06-08 12:53:16,755 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - session.id is deprecated. Instead, use dfs.metrics.session-id
0 [main] INFO org.apache.hadoop.conf.Configuration.deprecation  - session.id is deprecated. Instead, use dfs.metrics.session-id
2020-06-08 12:53:16,759 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
4 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics  - Initializing JVM Metrics with processName=JobTracker, sessionId=
2020-06-08 12:53:17,425 WARN  [main] mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
670 [main] WARN org.apache.hadoop.mapreduce.JobResourceUploader  - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2020-06-08 12:53:17,455 WARN  [main] mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
700 [main] WARN org.apache.hadoop.mapreduce.JobResourceUploader  - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2020-06-08 12:53:17,526 INFO  [main] input.FileInputFormat (FileInputFormat.java:listStatus(283)) - Total input paths to process : 2
771 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat  - Total input paths to process : 2
2020-06-08 12:53:17,555 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(198)) - number of splits:2
800 [main] INFO org.apache.hadoop.mapreduce.JobSubmitter  - number of splits:2
2020-06-08 12:53:17,663 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:printTokens(287)) - Submitting tokens for job: job_local1187953555_0001
908 [main] INFO org.apache.hadoop.mapreduce.JobSubmitter  - Submitting tokens for job: job_local1187953555_0001
2020-06-08 12:53:17,836 INFO  [main] mapreduce.Job (Job.java:submit(1294)) - The url to track the job: http://localhost:8080/
1081 [main] INFO org.apache.hadoop.mapreduce.Job  - The url to track the job: http://localhost:8080/
2020-06-08 12:53:17,838 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
1083 [Thread-3] INFO org.apache.hadoop.mapred.LocalJobRunner  - OutputCommitter set in config null
2020-06-08 12:53:17,844 INFO  [Thread-3] output.FileOutputCommitter (FileOutputCommitter.java:<init>(100)) - File Output Committer Algorithm version is 1
1089 [Thread-3] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter  - File Output Committer Algorithm version is 1
2020-06-08 12:53:17,846 INFO  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
1091 [Thread-3] INFO org.apache.hadoop.mapred.LocalJobRunner  - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2020-06-08 12:53:17,876 WARN  [Thread-3] mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1187953555_0001
org.apache.hadoop.security.AccessControlException: Permission denied: user=????, access=WRITE, inode="/456/output/_temporary/0":root:supergroup:drwxr----x
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190)