hadoop-auth NoSuchMethodError: org.apache.hadoop.security.HadoopKerberosName.setRuleMechanism

最新推荐文章于 2024-11-18 17:04:39 发布

原创

最新推荐文章于 2024-11-18 17:04:39 发布 · 2.7k 阅读

1 ·

CC 4.0 BY-SA版权

文章标签：

#hadoop #hbase #spark

本文记录了在Hadoop 3.2.1、HBase 2.3.7及Spark 3.2.0环境下集成过程中遇到的NoSuchMethodError异常。此错误与Hadoop的安全认证模块版本不匹配有关。

hadoop 3.2.1
hbase 2.3.7
spark 3.2.0
pom hadoop-auth是由hbase默认导入的2.10.0版本，更新导入版本3.2.1

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.security.HadoopKerberosName.setRuleMechanism(Ljava/lang/String;)V
	at org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:84)
	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:315)
	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:300)
	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:575)
	at org.apache.hadoop.hbase.security.User$SecureHadoopUser.<init>(User.java:300)
	at org.apache.hadoop.hbase.security.User.getCurrent(User.java:173)
	at org.apache.hadoop.hbase.security.UserProvider.getCurrent(UserProvider.java:187)
	at org.apache.hadoop.hbase.AuthUtil.loginClient(AuthUtil.java:107