sudo oozie-setup sharelib create -fs hdfs://cdh1:8020 -locallib /usr/lib/oozie/ 报错

最新推荐文章于 2022-11-21 22:48:29 发布

大而话之-Big Data

最新推荐文章于 2022-11-21 22:48:29 发布

阅读量317

点赞数

CC 4.0 BY-SA版权

分类专栏： Hadoop

本文链接：https://blog.youkuaiyun.com/panxiaojun/article/details/85886636

Hadoop 专栏收录该内容

15 篇文章

订阅专栏

本文详细记录了在配置Oozie过程中遇到的权限错误，并提供了具体的解决方案，包括修改oozie-site.xml和core-site.xml文件，以及如何刷新超级用户组配置。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

今天在配置ooize，执行oozie-setup时，报出下面的错误，

因为忽略了下面的配置，导致排错了好长时间，请大家注意！

sudo oozie-setup sharelib create -fs hdfs://cdh1:8020 -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz

by: java.lang.IllegalArgumentException: Server has invalid Kerberos principal: hdfs/cdh1@TEST.COM
        at org.apache.hadoop.security.SaslRpcClient.getServerPrincipal(SaslRpcClient.java:334)
        at org.apache.hadoop.security.SaslRpcClient.createSaslClient(SaslRpcClient.java:231)
        at org.apache.hadoop.security.SaslRpcClient.selectSaslClient(SaslRpcClient.java:159)
        at org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:396)
        at org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:553)
        at org.apache.hadoop.ipc.Client$Connection.access$1800(Client.java:368)
        at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:722)
        at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:718)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:717)
        ... 27 more
--------------------------------------

org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: oozie/cdh1@TEST.COM is not allowed to impersonate oozie

解决方法

vi /etc/oozie/conf/oozie-site.xml

<property>
<name>oozie.service.HadoopAccessorService.hadoop.configurations</name>
<value>*=/etc/hadoop/conf/</value>

</property>

vi /etc/hadoop/conf/core-site.xml

<property>
<name>hadoop.proxyuser.oozie.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.oozie.groups</name>
<value>*</value>
</property>

增加以上配置后，无需重启集群，执行下面的命令，重新加载这两个属性

hdfs dfsadmin –refreshSuperUserGroupsConfiguration
yarn rmadmin –refreshSuperUserGroupsConfiguration12

如果集群配置了HA，需要在为主备namenode

hadoop dfsadmin -fs hdfs://CDH1:9000 –refreshSuperUserGroupsConfiguration
hadoop dfsadmin -fs hdfs://CDH2:9000 –refreshSuperUserGroupsConfiguration