[Hadoop]ERROR security.UserGroupInformation:PriviledgedActionException as:Administrator

最新推荐文章于 2022-06-26 23:04:39 发布

mango_song

最新推荐文章于 2022-06-26 23:04:39 发布

阅读量1.3w

点赞数 2

CC 4.0 BY-SA版权

分类专栏： hadoop 文章标签： hadoop PriviledgedActionExc

本文链接：https://blog.youkuaiyun.com/mango_song/article/details/8314498

hadoop 专栏收录该内容

46 篇文章

订阅专栏

原：http://blog.youkuaiyun.com/shiqidide/article/details/7585048

hadoop1.0.4在windows远程调试linux的程序时，报错:

12/04/24 15:32:44 WARNutil.NativeCodeLoader: Unable to load native-hadoop library foryour platform... using builtin-java classes where applicable
12/04/24 15:32:44 ERROR security.UserGroupInformation:PriviledgedActionException as:Administratorcause:java.io.IOException: Failed to set permissions of path:\tmp\hadoop-Administrator\mapred\staging\Administrator-519341271\.stagingto 0700
Exception in thread "main" java.io.IOException: Failed to setpermissions of path:\tmp\hadoop-Administrator\mapred\staging\Administrator-519341271\.stagingto 0700
    atorg.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
    atorg.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
    atorg.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
    atorg.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
    atorg.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
    atorg.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
    atorg.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
    atorg.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
    atjava.security.AccessController.doPrivileged(Native Method)
    atjavax.security.auth.Subject.doAs(Subject.java:396)
    atorg.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
    atorg.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
    atorg.apache.hadoop.mapreduce.Job.submit(Job.java:500)
    atorg.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
    atcom.hadoop.learn.test.WordCountTest.main(WordCountTest.java:85)

这个是Windows下文件权限问题，在Linux下可以正常运行，不存在这样的问题。

解决方法是：修改hdfs /tmp目录权限

mango@master:~/hadoop-1.0.4/bin$ ./hadoop dfs -chmod -R 777   /tmp  
mango@master:~/hadoop-1.0.4/bin$ ./hadoop dfs -ls /tmp            
Found 1 items
drwxrwxrwx   - mango supergroup          0 2013-01-14 16:07 /tmp/hadoop-mango

再运行就应该不报错了。如果还有错：

解决方法是，修改/hadoop-1.0.4/src/core/org/apache/hadoop/fs/FileUtil.java里面的checkReturnValue，注释掉即可（有些粗暴，在Window下，可以不用检查）

[java]view plaincopy
 ......  
   private static void checkReturnValue(boolean rv, File p,  
                                        FsPermission permission  
                                        ) throws IOException {  
       
   }  
 ......  

重新编译打包hadoop-core-1.0.4.jar，替换掉hadoop-1.0.4根目录下的hadoop-core-1.0.4.jar即可。

以下是我编译成功的hadop-core-1.0.4.jar：http://download.youkuaiyun.com/detail/snow_eagle_howard/4842134

替换之后，刷新项目，设置好正确的jar包依赖，现在再运行WordCountTest，即可。

//还有一个常见的权限异常：

ERROR security.UserGroupInformation: PriviledgedActionException as:Administrator cause:org.apache.hadoop.security.AccessControlException: org.apache.hadoop.security.AccessControlException: Permission denied: user=Administrator, access=WRITE, inode="mapred":mango:supergroup:rwxr-xr-x
Exception in thread "main" org.apache.hadoop.security.AccessControlException: org.apache.hadoop.security.AccessControlException: Permission denied: user=Administrator, access=WRITE, inode="mapred":mango:supergroup:rwxr-xr-x
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

.......

解决办法时将 /tmp目录权限设置为777