Hadoop认证Kerberos--UserGroupInformation.doAs

本文深入探讨了在访问Hadoop生态圈服务时使用Kerberos认证的必要性,详细解析了如何利用keytab文件进行身份验证,并阐述了UserGroupInformation与Subject在认证过程中的作用。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

在访问带有kerberos认证的hadoop生态圈服务时,必须带上keytab文件认证。

常用的代码:

String userCode="user1";
String keytabPath = "./user1.keytab";
System.setProperty("java.security.krb5.kdc", kdc); 
System.setProperty("java.security.krb5.realm", realm);
final Configuration conf = new Configuration();
UserGroupInformation ugi = UserGroupInformation.loginUserFromKeytabAndReturnUGI(userCode, keytabPath);
final HConnection connection;
ugi.doAs(new PrivilegedAction<Object>() {

	@Override
	public Object run() {
		try {
			connection = HConnectionManager.createConnection(conf);
		} catch (IOException e) {
			// TODO Auto-generated catch block
			e.printStackTrace();
		}
		return null;
	}
});

userCode是用户的名称,keytabPath是keytab文件的路径,一般系统是采用kdc生成的验证文件,来进行系统登录。系统不需要知道密码。   

    这里的ugi,就是kerberos的ticket, 是通过 UserGroupInformation.loginUserFromKeytabAndReturnUGI(userCode,keytabPath); 这个方法
成功后,返回的票据信息,通过这个票据,可以在没过期的情况下,用来访问hadoop系统。

  重点是要说明,为什么要用这个票据的doAs方法来进行访问。首先我们看下UserGroupInformation的代码:

  @InterfaceAudience.Public
  @InterfaceStability.Evolving
  public <T> T doAs(PrivilegedAction<T> action) {
    logPrivilegedAction(subject, action);
    return Subject.doAs(subject, action);
  }


logPrivilegedAction是记录日志信息,先不用管,关键在Subject.doAs,事实上,这个是jdk的代码

   

public static <T> T doAs(final Subject subject,
                        final java.security.PrivilegedAction<T> action) {
 
        java.lang.SecurityManager sm = System.getSecurityManager();
        if (sm != null) {
            sm.checkPermission(AuthPermissionHolder.DO_AS_PERMISSION);
        }
        if (action == null)
            throw new NullPointerException
                (ResourcesMgr.getString("invalid.null.action.provided"));
 
        // set up the new Subject-based AccessControlContext
        // for doPrivileged
        final AccessControlContext currentAcc = AccessController.getContext();
 
        // call doPrivileged and push this new context on the stack
        return java.security.AccessController.doPrivileged
                                        (action,
                                        createContext(subject, currentAcc));
    }

最后的代码是原生的看不到了,根据注释,可以看出,这里是新开了一个上下文,这个上下文是subject来初始化的,然后调用我们的连接方法。


subject就是存放票据的地方,Userinformation初始化后,就不可变了 

定义是 privatefinal Subjectsubject;

为什么有的时候,不用doAs方法,调用认证的方法后,也可以正常访问kerberos的hadoop集群呢?  这里看下 loginUserFromKeytabAndReturnUGI的方法

 

 static UserGroupInformation loginUserFromKeytabAndReturnUGI(String user,
                                  String path
                                  ) throws IOException {
    if (!isSecurityEnabled())
      return UserGroupInformation.getCurrentUser();
    String oldKeytabFile = null;
    String oldKeytabPrincipal = null;
 
    long start = 0;
    try {
      oldKeytabFile = keytabFile;
      oldKeytabPrincipal = keytabPrincipal;
      keytabFile = path;
      keytabPrincipal = user;
      Subject subject = new Subject();
      
      LoginContext login = newLoginContext(
          HadoopConfiguration.KEYTAB_KERBEROS_CONFIG_NAME, subject,
          new HadoopConfiguration());
       
      start = Time.now();
      login.login();
      metrics.loginSuccess.add(Time.now() - start);
      UserGroupInformation newLoginUser = new UserGroupInformation(subject);
      newLoginUser.setLogin(login);
      newLoginUser.setAuthenticationMethod(AuthenticationMethod.KERBEROS);
      
      return newLoginUser;
    }


 

private static LoginContext   newLoginContext(String appName, Subject subject,     javax.security.auth.login.Configuration loginConf)       throws LoginException {     
    // Temporarily switch the thread's ContextClassLoader to match this     
// class's classloader, so that we can properly load HadoopLoginModule    
 // from the JAAS libraries.     
Thread t = Thread.currentThread();     
ClassLoader oldCCL = t.getContextClassLoader(); t.setContextClassLoader(HadoopLoginModule.class.getClassLoader());     
try {       
    return new LoginContext(appName, subject, null, loginConf);     
} finally {       
t.setContextClassLoader(oldCCL);     
}   
}


  

 LoginContext login 这个方法,是把当前线程的,切换到登录后subject上面去了,也就是当前线程的上下文,具备了登录信息,也就不需要用doAs的方法,也可以正常访问kerberos.
  不过这种方式有局限性:

   1.切换用户,必须进行一次登录操作,频繁登录,给kdc服务器造成压力,kerberos的票据,是有保存期限的,在期限里面,我们不需要登录。

   2.这种方式对jdk有依赖,根据实践,IBM的jdk,重复登录,无法切换到新的用户,必须用doAs的方式才正常。
 

C:\Users\刘凯\.jdks\openjdk-24.0.1\bin\java.exe -javaagent:C:\Users\刘凯\AppData\Local\JetBrains\IntelliJIdea2025.1\captureAgent\debugger-agent.jar=file:///C:/Users/%E5%88%98%E5%87%AF/AppData/Local/Temp/capture8783787118609926858.props -ea -Didea.test.cyclic.buffer.size=1048576 "-javaagent:D:\IDEA\IntelliJ IDEA 2025.1.1.1\lib\idea_rt.jar=54651" -Dkotlinx.coroutines.debug.enable.creation.stack.trace=false -Ddebugger.agent.enable.coroutines=true -Dkotlinx.coroutines.debug.enable.flows.stack.trace=true -Dkotlinx.coroutines.debug.enable.mutable.state.flows.stack.trace=true -Dfile.encoding=UTF-8 -Dsun.stdout.encoding=UTF-8 -Dsun.stderr.encoding=UTF-8 -classpath "D:\IDEA\IntelliJ IDEA 2025.1.1.1\lib\idea_rt.jar;D:\IDEA\IntelliJ IDEA 2025.1.1.1\plugins\junit\lib\junit5-rt.jar;D:\IDEA\IntelliJ IDEA 2025.1.1.1\plugins\junit\lib\junit-rt.jar;D:\maven\repository\hdfsAPI\target\test-classes;D:\maven\repository\hdfsAPI\target\classes;D:\maven\repository\org\apache\hadoop\hadoop-client\3.1.3\hadoop-client-3.1.3.jar;D:\maven\repository\org\apache\hadoop\hadoop-common\3.1.3\hadoop-common-3.1.3.jar;D:\maven\repository\com\google\guava\guava\27.0-jre\guava-27.0-jre.jar;D:\maven\repository\com\google\guava\failureaccess\1.0\failureaccess-1.0.jar;D:\maven\repository\com\google\guava\listenablefuture\9999.0-empty-to-avoid-conflict-with-guava\listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar;D:\maven\repository\org\checkerframework\checker-qual\2.5.2\checker-qual-2.5.2.jar;D:\maven\repository\com\google\errorprone\error_prone_annotations\2.2.0\error_prone_annotations-2.2.0.jar;D:\maven\repository\com\google\j2objc\j2objc-annotations\1.1\j2objc-annotations-1.1.jar;D:\maven\repository\org\codehaus\mojo\animal-sniffer-annotations\1.17\animal-sniffer-annotations-1.17.jar;D:\maven\repository\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;D:\maven\repository\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;D:\maven\repository\org\apache\httpcomponents\httpclient\4.5.2\httpclient-4.5.2.jar;D:\maven\repository\org\apache\httpcomponents\httpcore\4.4.4\httpcore-4.4.4.jar;D:\maven\repository\commons-codec\commons-codec\1.11\commons-codec-1.11.jar;D:\maven\repository\commons-io\commons-io\2.5\commons-io-2.5.jar;D:\maven\repository\commons-net\commons-net\3.6\commons-net-3.6.jar;D:\maven\repository\commons-collections\commons-collections\3.2.2\commons-collections-3.2.2.jar;D:\maven\repository\org\eclipse\jetty\jetty-servlet\9.3.24.v20180605\jetty-servlet-9.3.24.v20180605.jar;D:\maven\repository\org\eclipse\jetty\jetty-security\9.3.24.v20180605\jetty-security-9.3.24.v20180605.jar;D:\maven\repository\org\eclipse\jetty\jetty-webapp\9.3.24.v20180605\jetty-webapp-9.3.24.v20180605.jar;D:\maven\repository\org\eclipse\jetty\jetty-xml\9.3.24.v20180605\jetty-xml-9.3.24.v20180605.jar;D:\maven\repository\javax\servlet\jsp\jsp-api\2.1\jsp-api-2.1.jar;D:\maven\repository\com\sun\jersey\jersey-servlet\1.19\jersey-servlet-1.19.jar;D:\maven\repository\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;D:\maven\repository\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;D:\maven\repository\commons-beanutils\commons-beanutils\1.9.3\commons-beanutils-1.9.3.jar;D:\maven\repository\org\apache\commons\commons-configuration2\2.1.1\commons-configuration2-2.1.1.jar;D:\maven\repository\org\apache\commons\commons-lang3\3.4\commons-lang3-3.4.jar;D:\maven\repository\org\apache\avro\avro\1.7.7\avro-1.7.7.jar;D:\maven\repository\org\codehaus\jackson\jackson-core-asl\1.9.13\jackson-core-asl-1.9.13.jar;D:\maven\repository\org\codehaus\jackson\jackson-mapper-asl\1.9.13\jackson-mapper-asl-1.9.13.jar;D:\maven\repository\com\thoughtworks\paranamer\paranamer\2.3\paranamer-2.3.jar;D:\maven\repository\org\xerial\snappy\snappy-java\1.0.5\snappy-java-1.0.5.jar;D:\maven\repository\com\google\re2j\re2j\1.1\re2j-1.1.jar;D:\maven\repository\com\google\protobuf\protobuf-java\2.5.0\protobuf-java-2.5.0.jar;D:\maven\repository\com\google\code\gson\gson\2.2.4\gson-2.2.4.jar;D:\maven\repository\org\apache\hadoop\hadoop-auth\3.1.3\hadoop-auth-3.1.3.jar;D:\maven\repository\com\nimbusds\nimbus-jose-jwt\4.41.1\nimbus-jose-jwt-4.41.1.jar;D:\maven\repository\com\github\stephenc\jcip\jcip-annotations\1.0-1\jcip-annotations-1.0-1.jar;D:\maven\repository\net\minidev\json-smart\2.3\json-smart-2.3.jar;D:\maven\repository\net\minidev\accessors-smart\1.2\accessors-smart-1.2.jar;D:\maven\repository\org\ow2\asm\asm\5.0.4\asm-5.0.4.jar;D:\maven\repository\org\apache\curator\curator-framework\2.13.0\curator-framework-2.13.0.jar;D:\maven\repository\org\apache\curator\curator-client\2.13.0\curator-client-2.13.0.jar;D:\maven\repository\org\apache\curator\curator-recipes\2.13.0\curator-recipes-2.13.0.jar;D:\maven\repository\com\google\code\findbugs\jsr305\3.0.0\jsr305-3.0.0.jar;D:\maven\repository\org\apache\htrace\htrace-core4\4.1.0-incubating\htrace-core4-4.1.0-incubating.jar;D:\maven\repository\org\apache\commons\commons-compress\1.18\commons-compress-1.18.jar;D:\maven\repository\org\apache\kerby\kerb-simplekdc\1.0.1\kerb-simplekdc-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerb-client\1.0.1\kerb-client-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerby-config\1.0.1\kerby-config-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerb-core\1.0.1\kerb-core-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerby-pkix\1.0.1\kerby-pkix-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerby-asn1\1.0.1\kerby-asn1-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerby-util\1.0.1\kerby-util-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerb-common\1.0.1\kerb-common-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerb-crypto\1.0.1\kerb-crypto-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerb-util\1.0.1\kerb-util-1.0.1.jar;D:\maven\repository\org\apache\kerby\token-provider\1.0.1\token-provider-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerb-admin\1.0.1\kerb-admin-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerb-server\1.0.1\kerb-server-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerb-identity\1.0.1\kerb-identity-1.0.1.jar;D:\maven\repository\org\apache\kerby\kerby-xdr\1.0.1\kerby-xdr-1.0.1.jar;D:\maven\repository\com\fasterxml\jackson\core\jackson-databind\2.7.8\jackson-databind-2.7.8.jar;D:\maven\repository\com\fasterxml\jackson\core\jackson-core\2.7.8\jackson-core-2.7.8.jar;D:\maven\repository\org\codehaus\woodstox\stax2-api\3.1.4\stax2-api-3.1.4.jar;D:\maven\repository\com\fasterxml\woodstox\woodstox-core\5.0.3\woodstox-core-5.0.3.jar;D:\maven\repository\org\apache\hadoop\hadoop-hdfs-client\3.1.3\hadoop-hdfs-client-3.1.3.jar;D:\maven\repository\com\squareup\okhttp\okhttp\2.7.5\okhttp-2.7.5.jar;D:\maven\repository\com\squareup\okio\okio\1.6.0\okio-1.6.0.jar;D:\maven\repository\com\fasterxml\jackson\core\jackson-annotations\2.7.8\jackson-annotations-2.7.8.jar;D:\maven\repository\org\apache\hadoop\hadoop-yarn-api\3.1.3\hadoop-yarn-api-3.1.3.jar;D:\maven\repository\javax\xml\bind\jaxb-api\2.2.11\jaxb-api-2.2.11.jar;D:\maven\repository\org\apache\hadoop\hadoop-yarn-client\3.1.3\hadoop-yarn-client-3.1.3.jar;D:\maven\repository\org\apache\hadoop\hadoop-mapreduce-client-core\3.1.3\hadoop-mapreduce-client-core-3.1.3.jar;D:\maven\repository\org\apache\hadoop\hadoop-yarn-common\3.1.3\hadoop-yarn-common-3.1.3.jar;D:\maven\repository\javax\servlet\javax.servlet-api\3.1.0\javax.servlet-api-3.1.0.jar;D:\maven\repository\org\eclipse\jetty\jetty-util\9.3.24.v20180605\jetty-util-9.3.24.v20180605.jar;D:\maven\repository\com\sun\jersey\jersey-core\1.19\jersey-core-1.19.jar;D:\maven\repository\javax\ws\rs\jsr311-api\1.1.1\jsr311-api-1.1.1.jar;D:\maven\repository\com\sun\jersey\jersey-client\1.19\jersey-client-1.19.jar;D:\maven\repository\com\fasterxml\jackson\module\jackson-module-jaxb-annotations\2.7.8\jackson-module-jaxb-annotations-2.7.8.jar;D:\maven\repository\com\fasterxml\jackson\jaxrs\jackson-jaxrs-json-provider\2.7.8\jackson-jaxrs-json-provider-2.7.8.jar;D:\maven\repository\com\fasterxml\jackson\jaxrs\jackson-jaxrs-base\2.7.8\jackson-jaxrs-base-2.7.8.jar;D:\maven\repository\org\apache\hadoop\hadoop-mapreduce-client-jobclient\3.1.3\hadoop-mapreduce-client-jobclient-3.1.3.jar;D:\maven\repository\org\apache\hadoop\hadoop-mapreduce-client-common\3.1.3\hadoop-mapreduce-client-common-3.1.3.jar;D:\maven\repository\org\apache\hadoop\hadoop-annotations\3.1.3\hadoop-annotations-3.1.3.jar;D:\maven\repository\junit\junit\4.12\junit-4.12.jar;D:\maven\repository\org\hamcrest\hamcrest-core\1.3\hamcrest-core-1.3.jar;D:\maven\repository\org\slf4j\slf4j-log4j12\1.7.30\slf4j-log4j12-1.7.30.jar;D:\maven\repository\org\slf4j\slf4j-api\1.7.30\slf4j-api-1.7.30.jar;D:\maven\repository\log4j\log4j\1.2.17\log4j-1.2.17.jar" com.intellij.rt.junit.JUnitStarter -ideVersion5 -junit4 com.hadoop.hdfs.HDFSClient java.lang.UnsupportedOperationException: getSubject is not supported at java.base/javax.security.auth.Subject.getSubject(Subject.java:277) at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:568) at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3487) at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3477) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3319) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479) at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:217) at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:214) at java.base/jdk.internal.vm.ScopedValueContainer.callWithoutScope(ScopedValueContainer.java:162) at java.base/jdk.internal.vm.ScopedValueContainer.call(ScopedValueContainer.java:147) at java.base/java.lang.ScopedValue$Carrier.call(ScopedValue.java:422) at java.base/javax.security.auth.Subject.callAs(Subject.java:331) at java.base/javax.security.auth.Subject.doAs(Subject.java:440) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:214) at com.hadoop.hdfs.HDFSClient.initConn(HDFSClient.java:26) at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) at java.base/java.lang.reflect.Method.invoke(Method.java:565) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69) at com.intellij.rt.junit.IdeaTestRunner$Repeater$1.execute(IdeaTestRunner.java:38) at com.intellij.rt.execution.junit.TestsRepeater.repeat(TestsRepeater.java:11) at com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:35) at com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:231) at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:55) java.lang.UnsupportedOperationException: getSubject is not supported at java.base/javax.security.auth.Subject.getSubject(Subject.java:277) at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:568) at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3487) at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3477) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3319) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479) at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:217) at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:214) at java.base/jdk.internal.vm.ScopedValueContainer.callWithoutScope(ScopedValueContainer.java:162) at java.base/jdk.internal.vm.ScopedValueContainer.call(ScopedValueContainer.java:147) at java.base/java.lang.ScopedValue$Carrier.call(ScopedValue.java:422) at java.base/javax.security.auth.Subject.callAs(Subject.java:331) at java.base/javax.security.auth.Subject.doAs(Subject.java:440) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:214) at com.hadoop.hdfs.HDFSClient.initConn(HDFSClient.java:26) at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) at java.base/java.lang.reflect.Method.invoke(Method.java:565) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69) at com.intellij.rt.junit.IdeaTestRunner$Repeater$1.execute(IdeaTestRunner.java:38) at com.intellij.rt.execution.junit.TestsRepeater.repeat(TestsRepeater.java:11) at com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:35) at com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:231) at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:55) java.lang.UnsupportedOperationException: getSubject is not supported at java.base/javax.security.auth.Subject.getSubject(Subject.java:277) at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:568) at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3487) at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3477) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3319) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479) at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:217) at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:214) at java.base/jdk.internal.vm.ScopedValueContainer.callWithoutScope(ScopedValueContainer.java:162) at java.base/jdk.internal.vm.ScopedValueContainer.call(ScopedValueContainer.java:147) at java.base/java.lang.ScopedValue$Carrier.call(ScopedValue.java:422) at java.base/javax.security.auth.Subject.callAs(Subject.java:331) at java.base/javax.security.auth.Subject.doAs(Subject.java:440) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:214) at com.hadoop.hdfs.HDFSClient.initConn(HDFSClient.java:26) at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) at java.base/java.lang.reflect.Method.invoke(Method.java:565) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69) at com.intellij.rt.junit.IdeaTestRunner$Repeater$1.execute(IdeaTestRunner.java:38) at com.intellij.rt.execution.junit.TestsRepeater.repeat(TestsRepeater.java:11) at com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:35) at com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:231) at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:55) 进程已结束,退出代码为 -1
05-28
"C:\Program Files\Java\jdk1.8.0_144\bin\java.exe" "-javaagent:D:\Idea 2024\IntelliJ IDEA 2024.3.1.1\lib\idea_rt.jar=65415:D:\Idea 2024\IntelliJ IDEA 2024.3.1.1\bin" -Dfile.encoding=UTF-8 -classpath "C:\Program Files\Java\jdk1.8.0_144\jre\lib\charsets.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\deploy.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\access-bridge-64.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\cldrdata.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\dnsns.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\jaccess.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\jfxrt.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\localedata.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\nashorn.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\sunec.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\sunjce_provider.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\sunmscapi.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\sunpkcs11.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\zipfs.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\javaws.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\jce.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\jfr.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\jfxswt.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\jsse.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\management-agent.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\plugin.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\resources.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\rt.jar;D:\code\Hbase_hadoop\HomeWork1\target\classes;D:\maven\local repository\junit\junit\3.8.1\junit-3.8.1.jar;D:\maven\local repository\org\apache\hadoop\hadoop-client\2.8.5\hadoop-client-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-hdfs-client\2.8.5\hadoop-hdfs-client-2.8.5.jar;D:\maven\local repository\com\squareup\okhttp\okhttp\2.4.0\okhttp-2.4.0.jar;D:\maven\local repository\com\squareup\okio\okio\1.4.0\okio-1.4.0.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-app\2.8.5\hadoop-mapreduce-client-app-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-common\2.8.5\hadoop-mapreduce-client-common-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-yarn-server-common\2.8.5\hadoop-yarn-server-common-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-shuffle\2.8.5\hadoop-mapreduce-client-shuffle-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-yarn-api\2.8.5\hadoop-yarn-api-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-jobclient\2.8.5\hadoop-mapreduce-client-jobclient-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-annotations\2.8.5\hadoop-annotations-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-common\2.8.5\hadoop-common-2.8.5.jar;D:\maven\local repository\com\google\guava\guava\11.0.2\guava-11.0.2.jar;D:\maven\local repository\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;D:\maven\local repository\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;D:\maven\local repository\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;D:\maven\local repository\org\apache\httpcomponents\httpclient\4.5.2\httpclient-4.5.2.jar;D:\maven\local repository\org\apache\httpcomponents\httpcore\4.4.4\httpcore-4.4.4.jar;D:\maven\local repository\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;D:\maven\local repository\commons-io\commons-io\2.4\commons-io-2.4.jar;D:\maven\local repository\commons-net\commons-net\3.1\commons-net-3.1.jar;D:\maven\local repository\commons-collections\commons-collections\3.2.2\commons-collections-3.2.2.jar;D:\maven\local repository\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\maven\local repository\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;D:\maven\local repository\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;D:\maven\local repository\org\mortbay\jetty\jetty-sslengine\6.1.26\jetty-sslengine-6.1.26.jar;D:\maven\local repository\javax\servlet\jsp\jsp-api\2.1\jsp-api-2.1.jar;D:\maven\local repository\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;D:\maven\local repository\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;D:\maven\local repository\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;D:\maven\local repository\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;D:\maven\local repository\org\codehaus\jackson\jackson-jaxrs\1.8.3\jackson-jaxrs-1.8.3.jar;D:\maven\local repository\org\codehaus\jackson\jackson-xc\1.8.3\jackson-xc-1.8.3.jar;D:\maven\local repository\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;D:\maven\local repository\asm\asm\3.1\asm-3.1.jar;D:\maven\local repository\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;D:\maven\local repository\log4j\log4j\1.2.17\log4j-1.2.17.jar;D:\maven\local repository\net\java\dev\jets3t\jets3t\0.9.0\jets3t-0.9.0.jar;D:\maven\local repository\com\jamesmurty\utils\java-xmlbuilder\0.4\java-xmlbuilder-0.4.jar;D:\maven\local repository\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;D:\maven\local repository\commons-configuration\commons-configuration\1.6\commons-configuration-1.6.jar;D:\maven\local repository\commons-digester\commons-digester\1.8\commons-digester-1.8.jar;D:\maven\local repository\commons-beanutils\commons-beanutils\1.7.0\commons-beanutils-1.7.0.jar;D:\maven\local repository\commons-beanutils\commons-beanutils-core\1.8.0\commons-beanutils-core-1.8.0.jar;D:\maven\local repository\org\slf4j\slf4j-api\1.7.10\slf4j-api-1.7.10.jar;D:\maven\local repository\org\slf4j\slf4j-log4j12\1.7.10\slf4j-log4j12-1.7.10.jar;D:\maven\local repository\org\codehaus\jackson\jackson-core-asl\1.9.13\jackson-core-asl-1.9.13.jar;D:\maven\local repository\org\codehaus\jackson\jackson-mapper-asl\1.9.13\jackson-mapper-asl-1.9.13.jar;D:\maven\local repository\org\apache\avro\avro\1.7.4\avro-1.7.4.jar;D:\maven\local repository\com\thoughtworks\paranamer\paranamer\2.3\paranamer-2.3.jar;D:\maven\local repository\org\xerial\snappy\snappy-java\1.0.4.1\snappy-java-1.0.4.1.jar;D:\maven\local repository\com\google\protobuf\protobuf-java\2.5.0\protobuf-java-2.5.0.jar;D:\maven\local repository\com\google\code\gson\gson\2.2.4\gson-2.2.4.jar;D:\maven\local repository\org\apache\hadoop\hadoop-auth\2.8.5\hadoop-auth-2.8.5.jar;D:\maven\local repository\com\nimbusds\nimbus-jose-jwt\4.41.1\nimbus-jose-jwt-4.41.1.jar;D:\maven\local repository\com\github\stephenc\jcip\jcip-annotations\1.0-1\jcip-annotations-1.0-1.jar;D:\maven\local repository\net\minidev\json-smart\2.3\json-smart-2.3.jar;D:\maven\local repository\net\minidev\accessors-smart\1.2\accessors-smart-1.2.jar;D:\maven\local repository\org\ow2\asm\asm\5.0.4\asm-5.0.4.jar;D:\maven\local repository\org\apache\directory\server\apacheds-kerberos-codec\2.0.0-M15\apacheds-kerberos-codec-2.0.0-M15.jar;D:\maven\local repository\org\apache\directory\server\apacheds-i18n\2.0.0-M15\apacheds-i18n-2.0.0-M15.jar;D:\maven\local repository\org\apache\directory\api\api-asn1-api\1.0.0-M20\api-asn1-api-1.0.0-M20.jar;D:\maven\local repository\org\apache\directory\api\api-util\1.0.0-M20\api-util-1.0.0-M20.jar;D:\maven\local repository\org\apache\curator\curator-framework\2.7.1\curator-framework-2.7.1.jar;D:\maven\local repository\com\jcraft\jsch\0.1.54\jsch-0.1.54.jar;D:\maven\local repository\org\apache\curator\curator-client\2.7.1\curator-client-2.7.1.jar;D:\maven\local repository\org\apache\curator\curator-recipes\2.7.1\curator-recipes-2.7.1.jar;D:\maven\local repository\com\google\code\findbugs\jsr305\3.0.0\jsr305-3.0.0.jar;D:\maven\local repository\org\apache\htrace\htrace-core4\4.0.1-incubating\htrace-core4-4.0.1-incubating.jar;D:\maven\local repository\org\apache\zookeeper\zookeeper\3.4.6\zookeeper-3.4.6.jar;D:\maven\local repository\org\apache\commons\commons-compress\1.4.1\commons-compress-1.4.1.jar;D:\maven\local repository\org\tukaani\xz\1.0\xz-1.0.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-core\2.8.5\hadoop-mapreduce-client-core-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-yarn-common\2.8.5\hadoop-yarn-common-2.8.5.jar;D:\maven\local repository\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;D:\maven\local repository\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;D:\maven\local repository\javax\activation\activation\1.1\activation-1.1.jar;D:\maven\local repository\com\sun\jersey\jersey-client\1.9\jersey-client-1.9.jar;D:\maven\local repository\com\google\inject\guice\3.0\guice-3.0.jar;D:\maven\local repository\javax\inject\javax.inject\1\javax.inject-1.jar;D:\maven\local repository\aopalliance\aopalliance\1.0\aopalliance-1.0.jar;D:\maven\local repository\com\sun\jersey\contribs\jersey-guice\1.9\jersey-guice-1.9.jar;D:\maven\local repository\com\google\inject\extensions\guice-servlet\3.0\guice-servlet-3.0.jar;D:\maven\local repository\io\netty\netty\3.6.2.Final\netty-3.6.2.Final.jar;D:\maven\local repository\org\apache\hbase\hbase-client\2.2.4\hbase-client-2.2.4.jar;D:\maven\local repository\org\apache\hbase\thirdparty\hbase-shaded-protobuf\2.2.1\hbase-shaded-protobuf-2.2.1.jar;D:\maven\local repository\org\apache\hbase\hbase-hadoop-compat\2.2.4\hbase-hadoop-compat-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-hadoop2-compat\2.2.4\hbase-hadoop2-compat-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-protocol-shaded\2.2.4\hbase-protocol-shaded-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-protocol\2.2.4\hbase-protocol-2.2.4.jar;D:\maven\local repository\org\apache\commons\commons-lang3\3.6\commons-lang3-3.6.jar;D:\maven\local repository\org\apache\hbase\thirdparty\hbase-shaded-miscellaneous\2.2.1\hbase-shaded-miscellaneous-2.2.1.jar;D:\maven\local repository\com\google\errorprone\error_prone_annotations\2.3.3\error_prone_annotations-2.3.3.jar;D:\maven\local repository\org\apache\hbase\thirdparty\hbase-shaded-netty\2.2.1\hbase-shaded-netty-2.2.1.jar;D:\maven\local repository\org\jruby\jcodings\jcodings\1.0.18\jcodings-1.0.18.jar;D:\maven\local repository\org\jruby\joni\joni\2.1.11\joni-2.1.11.jar;D:\maven\local repository\io\dropwizard\metrics\metrics-core\3.2.6\metrics-core-3.2.6.jar;D:\maven\local repository\org\apache\commons\commons-crypto\1.0.0\commons-crypto-1.0.0.jar;D:\maven\local repository\org\apache\yetus\audience-annotations\0.5.0\audience-annotations-0.5.0.jar;D:\maven\local repository\org\apache\hbase\hbase-common\2.2.4\hbase-common-2.2.4.jar;D:\maven\local repository\com\github\stephenc\findbugs\findbugs-annotations\1.3.9-1\findbugs-annotations-1.3.9-1.jar;D:\maven\local repository\org\apache\hbase\hbase-mapreduce\2.2.4\hbase-mapreduce-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-zookeeper\2.2.4\hbase-zookeeper-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-metrics\2.2.4\hbase-metrics-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-metrics-api\2.2.4\hbase-metrics-api-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-server\2.2.4\hbase-server-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-http\2.2.4\hbase-http-2.2.4.jar;D:\maven\local repository\org\eclipse\jetty\jetty-util\9.3.27.v20190418\jetty-util-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-util-ajax\9.3.27.v20190418\jetty-util-ajax-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-http\9.3.27.v20190418\jetty-http-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-security\9.3.27.v20190418\jetty-security-9.3.27.v20190418.jar;D:\maven\local repository\org\glassfish\jersey\core\jersey-server\2.25.1\jersey-server-2.25.1.jar;D:\maven\local repository\org\glassfish\jersey\core\jersey-common\2.25.1\jersey-common-2.25.1.jar;D:\maven\local repository\org\glassfish\jersey\bundles\repackaged\jersey-guava\2.25.1\jersey-guava-2.25.1.jar;D:\maven\local repository\org\glassfish\hk2\osgi-resource-locator\1.0.1\osgi-resource-locator-1.0.1.jar;D:\maven\local repository\org\glassfish\jersey\core\jersey-client\2.25.1\jersey-client-2.25.1.jar;D:\maven\local repository\org\glassfish\jersey\media\jersey-media-jaxb\2.25.1\jersey-media-jaxb-2.25.1.jar;D:\maven\local repository\javax\annotation\javax.annotation-api\1.2\javax.annotation-api-1.2.jar;D:\maven\local repository\org\glassfish\hk2\hk2-api\2.5.0-b32\hk2-api-2.5.0-b32.jar;D:\maven\local repository\org\glassfish\hk2\hk2-utils\2.5.0-b32\hk2-utils-2.5.0-b32.jar;D:\maven\local repository\org\glassfish\hk2\external\aopalliance-repackaged\2.5.0-b32\aopalliance-repackaged-2.5.0-b32.jar;D:\maven\local repository\org\glassfish\hk2\external\javax.inject\2.5.0-b32\javax.inject-2.5.0-b32.jar;D:\maven\local repository\org\glassfish\hk2\hk2-locator\2.5.0-b32\hk2-locator-2.5.0-b32.jar;D:\maven\local repository\org\javassist\javassist\3.20.0-GA\javassist-3.20.0-GA.jar;D:\maven\local repository\javax\validation\validation-api\1.1.0.Final\validation-api-1.1.0.Final.jar;D:\maven\local repository\org\glassfish\jersey\containers\jersey-container-servlet-core\2.25.1\jersey-container-servlet-core-2.25.1.jar;D:\maven\local repository\javax\ws\rs\javax.ws.rs-api\2.0.1\javax.ws.rs-api-2.0.1.jar;D:\maven\local repository\org\apache\hbase\hbase-procedure\2.2.4\hbase-procedure-2.2.4.jar;D:\maven\local repository\org\eclipse\jetty\jetty-server\9.3.27.v20190418\jetty-server-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-io\9.3.27.v20190418\jetty-io-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-servlet\9.3.27.v20190418\jetty-servlet-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-webapp\9.3.27.v20190418\jetty-webapp-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-xml\9.3.27.v20190418\jetty-xml-9.3.27.v20190418.jar;D:\maven\local repository\org\glassfish\web\javax.servlet.jsp\2.3.2\javax.servlet.jsp-2.3.2.jar;D:\maven\local repository\org\glassfish\javax.el\3.0.1-b12\javax.el-3.0.1-b12.jar;D:\maven\local repository\javax\servlet\jsp\javax.servlet.jsp-api\2.3.1\javax.servlet.jsp-api-2.3.1.jar;D:\maven\local repository\org\jamon\jamon-runtime\2.4.1\jamon-runtime-2.4.1.jar;D:\maven\local repository\javax\servlet\javax.servlet-api\3.1.0\javax.servlet-api-3.1.0.jar;D:\maven\local repository\com\lmax\disruptor\3.3.6\disruptor-3.3.6.jar;D:\maven\local repository\org\apache\hadoop\hadoop-distcp\2.8.5\hadoop-distcp-2.8.5.jar;D:\maven\local repository\org\apache\hbase\hbase-replication\2.2.4\hbase-replication-2.2.4.jar;D:\maven\local repository\org\apache\hadoop\hadoop-hdfs\2.8.5\hadoop-hdfs-2.8.5.jar;D:\maven\local repository\commons-daemon\commons-daemon\1.0.13\commons-daemon-1.0.13.jar;D:\maven\local repository\io\netty\netty-all\4.0.23.Final\netty-all-4.0.23.Final.jar;D:\maven\local repository\org\fusesource\leveldbjni\leveldbjni-all\1.8\leveldbjni-all-1.8.jar;D:\maven\local repository\org\apache\hadoop\hadoop-yarn-client\2.8.1\hadoop-yarn-client-2.8.1.jar" org.example.HBaseMapreduce.BrandAmount 2025-06-06 23:34:00,430 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum 2025-06-06 23:34:00,570 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 2025-06-06 23:34:00,809 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum 2025-06-06 23:34:01,793 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:host.name=LAPTOP-DET3CHHR 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_144 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:java.home=C:\Program Files\Java\jdk1.8.0_144\jre 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:java.class.path=C:\Program Files\Java\jdk1.8.0_144\jre\lib\charsets.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\deploy.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\access-bridge-64.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\cldrdata.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\dnsns.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\jaccess.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\jfxrt.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\localedata.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\nashorn.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\sunec.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\sunjce_provider.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\sunmscapi.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\sunpkcs11.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\ext\zipfs.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\javaws.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\jce.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\jfr.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\jfxswt.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\jsse.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\management-agent.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\plugin.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\resources.jar;C:\Program Files\Java\jdk1.8.0_144\jre\lib\rt.jar;D:\code\Hbase_hadoop\HomeWork1\target\classes;D:\maven\local repository\junit\junit\3.8.1\junit-3.8.1.jar;D:\maven\local repository\org\apache\hadoop\hadoop-client\2.8.5\hadoop-client-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-hdfs-client\2.8.5\hadoop-hdfs-client-2.8.5.jar;D:\maven\local repository\com\squareup\okhttp\okhttp\2.4.0\okhttp-2.4.0.jar;D:\maven\local repository\com\squareup\okio\okio\1.4.0\okio-1.4.0.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-app\2.8.5\hadoop-mapreduce-client-app-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-common\2.8.5\hadoop-mapreduce-client-common-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-yarn-server-common\2.8.5\hadoop-yarn-server-common-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-shuffle\2.8.5\hadoop-mapreduce-client-shuffle-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-yarn-api\2.8.5\hadoop-yarn-api-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-jobclient\2.8.5\hadoop-mapreduce-client-jobclient-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-annotations\2.8.5\hadoop-annotations-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-common\2.8.5\hadoop-common-2.8.5.jar;D:\maven\local repository\com\google\guava\guava\11.0.2\guava-11.0.2.jar;D:\maven\local repository\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;D:\maven\local repository\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;D:\maven\local repository\xmlenc\xmlenc\0.52\xmlenc-0.52.jar;D:\maven\local repository\org\apache\httpcomponents\httpclient\4.5.2\httpclient-4.5.2.jar;D:\maven\local repository\org\apache\httpcomponents\httpcore\4.4.4\httpcore-4.4.4.jar;D:\maven\local repository\commons-codec\commons-codec\1.4\commons-codec-1.4.jar;D:\maven\local repository\commons-io\commons-io\2.4\commons-io-2.4.jar;D:\maven\local repository\commons-net\commons-net\3.1\commons-net-3.1.jar;D:\maven\local repository\commons-collections\commons-collections\3.2.2\commons-collections-3.2.2.jar;D:\maven\local repository\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\maven\local repository\org\mortbay\jetty\jetty\6.1.26\jetty-6.1.26.jar;D:\maven\local repository\org\mortbay\jetty\jetty-util\6.1.26\jetty-util-6.1.26.jar;D:\maven\local repository\org\mortbay\jetty\jetty-sslengine\6.1.26\jetty-sslengine-6.1.26.jar;D:\maven\local repository\javax\servlet\jsp\jsp-api\2.1\jsp-api-2.1.jar;D:\maven\local repository\com\sun\jersey\jersey-core\1.9\jersey-core-1.9.jar;D:\maven\local repository\com\sun\jersey\jersey-json\1.9\jersey-json-1.9.jar;D:\maven\local repository\org\codehaus\jettison\jettison\1.1\jettison-1.1.jar;D:\maven\local repository\com\sun\xml\bind\jaxb-impl\2.2.3-1\jaxb-impl-2.2.3-1.jar;D:\maven\local repository\org\codehaus\jackson\jackson-jaxrs\1.8.3\jackson-jaxrs-1.8.3.jar;D:\maven\local repository\org\codehaus\jackson\jackson-xc\1.8.3\jackson-xc-1.8.3.jar;D:\maven\local repository\com\sun\jersey\jersey-server\1.9\jersey-server-1.9.jar;D:\maven\local repository\asm\asm\3.1\asm-3.1.jar;D:\maven\local repository\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;D:\maven\local repository\log4j\log4j\1.2.17\log4j-1.2.17.jar;D:\maven\local repository\net\java\dev\jets3t\jets3t\0.9.0\jets3t-0.9.0.jar;D:\maven\local repository\com\jamesmurty\utils\java-xmlbuilder\0.4\java-xmlbuilder-0.4.jar;D:\maven\local repository\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;D:\maven\local repository\commons-configuration\commons-configuration\1.6\commons-configuration-1.6.jar;D:\maven\local repository\commons-digester\commons-digester\1.8\commons-digester-1.8.jar;D:\maven\local repository\commons-beanutils\commons-beanutils\1.7.0\commons-beanutils-1.7.0.jar;D:\maven\local repository\commons-beanutils\commons-beanutils-core\1.8.0\commons-beanutils-core-1.8.0.jar;D:\maven\local repository\org\slf4j\slf4j-api\1.7.10\slf4j-api-1.7.10.jar;D:\maven\local repository\org\slf4j\slf4j-log4j12\1.7.10\slf4j-log4j12-1.7.10.jar;D:\maven\local repository\org\codehaus\jackson\jackson-core-asl\1.9.13\jackson-core-asl-1.9.13.jar;D:\maven\local repository\org\codehaus\jackson\jackson-mapper-asl\1.9.13\jackson-mapper-asl-1.9.13.jar;D:\maven\local repository\org\apache\avro\avro\1.7.4\avro-1.7.4.jar;D:\maven\local repository\com\thoughtworks\paranamer\paranamer\2.3\paranamer-2.3.jar;D:\maven\local repository\org\xerial\snappy\snappy-java\1.0.4.1\snappy-java-1.0.4.1.jar;D:\maven\local repository\com\google\protobuf\protobuf-java\2.5.0\protobuf-java-2.5.0.jar;D:\maven\local repository\com\google\code\gson\gson\2.2.4\gson-2.2.4.jar;D:\maven\local repository\org\apache\hadoop\hadoop-auth\2.8.5\hadoop-auth-2.8.5.jar;D:\maven\local repository\com\nimbusds\nimbus-jose-jwt\4.41.1\nimbus-jose-jwt-4.41.1.jar;D:\maven\local repository\com\github\stephenc\jcip\jcip-annotations\1.0-1\jcip-annotations-1.0-1.jar;D:\maven\local repository\net\minidev\json-smart\2.3\json-smart-2.3.jar;D:\maven\local repository\net\minidev\accessors-smart\1.2\accessors-smart-1.2.jar;D:\maven\local repository\org\ow2\asm\asm\5.0.4\asm-5.0.4.jar;D:\maven\local repository\org\apache\directory\server\apacheds-kerberos-codec\2.0.0-M15\apacheds-kerberos-codec-2.0.0-M15.jar;D:\maven\local repository\org\apache\directory\server\apacheds-i18n\2.0.0-M15\apacheds-i18n-2.0.0-M15.jar;D:\maven\local repository\org\apache\directory\api\api-asn1-api\1.0.0-M20\api-asn1-api-1.0.0-M20.jar;D:\maven\local repository\org\apache\directory\api\api-util\1.0.0-M20\api-util-1.0.0-M20.jar;D:\maven\local repository\org\apache\curator\curator-framework\2.7.1\curator-framework-2.7.1.jar;D:\maven\local repository\com\jcraft\jsch\0.1.54\jsch-0.1.54.jar;D:\maven\local repository\org\apache\curator\curator-client\2.7.1\curator-client-2.7.1.jar;D:\maven\local repository\org\apache\curator\curator-recipes\2.7.1\curator-recipes-2.7.1.jar;D:\maven\local repository\com\google\code\findbugs\jsr305\3.0.0\jsr305-3.0.0.jar;D:\maven\local repository\org\apache\htrace\htrace-core4\4.0.1-incubating\htrace-core4-4.0.1-incubating.jar;D:\maven\local repository\org\apache\zookeeper\zookeeper\3.4.6\zookeeper-3.4.6.jar;D:\maven\local repository\org\apache\commons\commons-compress\1.4.1\commons-compress-1.4.1.jar;D:\maven\local repository\org\tukaani\xz\1.0\xz-1.0.jar;D:\maven\local repository\org\apache\hadoop\hadoop-mapreduce-client-core\2.8.5\hadoop-mapreduce-client-core-2.8.5.jar;D:\maven\local repository\org\apache\hadoop\hadoop-yarn-common\2.8.5\hadoop-yarn-common-2.8.5.jar;D:\maven\local repository\javax\xml\bind\jaxb-api\2.2.2\jaxb-api-2.2.2.jar;D:\maven\local repository\javax\xml\stream\stax-api\1.0-2\stax-api-1.0-2.jar;D:\maven\local repository\javax\activation\activation\1.1\activation-1.1.jar;D:\maven\local repository\com\sun\jersey\jersey-client\1.9\jersey-client-1.9.jar;D:\maven\local repository\com\google\inject\guice\3.0\guice-3.0.jar;D:\maven\local repository\javax\inject\javax.inject\1\javax.inject-1.jar;D:\maven\local repository\aopalliance\aopalliance\1.0\aopalliance-1.0.jar;D:\maven\local repository\com\sun\jersey\contribs\jersey-guice\1.9\jersey-guice-1.9.jar;D:\maven\local repository\com\google\inject\extensions\guice-servlet\3.0\guice-servlet-3.0.jar;D:\maven\local repository\io\netty\netty\3.6.2.Final\netty-3.6.2.Final.jar;D:\maven\local repository\org\apache\hbase\hbase-client\2.2.4\hbase-client-2.2.4.jar;D:\maven\local repository\org\apache\hbase\thirdparty\hbase-shaded-protobuf\2.2.1\hbase-shaded-protobuf-2.2.1.jar;D:\maven\local repository\org\apache\hbase\hbase-hadoop-compat\2.2.4\hbase-hadoop-compat-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-hadoop2-compat\2.2.4\hbase-hadoop2-compat-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-protocol-shaded\2.2.4\hbase-protocol-shaded-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-protocol\2.2.4\hbase-protocol-2.2.4.jar;D:\maven\local repository\org\apache\commons\commons-lang3\3.6\commons-lang3-3.6.jar;D:\maven\local repository\org\apache\hbase\thirdparty\hbase-shaded-miscellaneous\2.2.1\hbase-shaded-miscellaneous-2.2.1.jar;D:\maven\local repository\com\google\errorprone\error_prone_annotations\2.3.3\error_prone_annotations-2.3.3.jar;D:\maven\local repository\org\apache\hbase\thirdparty\hbase-shaded-netty\2.2.1\hbase-shaded-netty-2.2.1.jar;D:\maven\local repository\org\jruby\jcodings\jcodings\1.0.18\jcodings-1.0.18.jar;D:\maven\local repository\org\jruby\joni\joni\2.1.11\joni-2.1.11.jar;D:\maven\local repository\io\dropwizard\metrics\metrics-core\3.2.6\metrics-core-3.2.6.jar;D:\maven\local repository\org\apache\commons\commons-crypto\1.0.0\commons-crypto-1.0.0.jar;D:\maven\local repository\org\apache\yetus\audience-annotations\0.5.0\audience-annotations-0.5.0.jar;D:\maven\local repository\org\apache\hbase\hbase-common\2.2.4\hbase-common-2.2.4.jar;D:\maven\local repository\com\github\stephenc\findbugs\findbugs-annotations\1.3.9-1\findbugs-annotations-1.3.9-1.jar;D:\maven\local repository\org\apache\hbase\hbase-mapreduce\2.2.4\hbase-mapreduce-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-zookeeper\2.2.4\hbase-zookeeper-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-metrics\2.2.4\hbase-metrics-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-metrics-api\2.2.4\hbase-metrics-api-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-server\2.2.4\hbase-server-2.2.4.jar;D:\maven\local repository\org\apache\hbase\hbase-http\2.2.4\hbase-http-2.2.4.jar;D:\maven\local repository\org\eclipse\jetty\jetty-util\9.3.27.v20190418\jetty-util-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-util-ajax\9.3.27.v20190418\jetty-util-ajax-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-http\9.3.27.v20190418\jetty-http-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-security\9.3.27.v20190418\jetty-security-9.3.27.v20190418.jar;D:\maven\local repository\org\glassfish\jersey\core\jersey-server\2.25.1\jersey-server-2.25.1.jar;D:\maven\local repository\org\glassfish\jersey\core\jersey-common\2.25.1\jersey-common-2.25.1.jar;D:\maven\local repository\org\glassfish\jersey\bundles\repackaged\jersey-guava\2.25.1\jersey-guava-2.25.1.jar;D:\maven\local repository\org\glassfish\hk2\osgi-resource-locator\1.0.1\osgi-resource-locator-1.0.1.jar;D:\maven\local repository\org\glassfish\jersey\core\jersey-client\2.25.1\jersey-client-2.25.1.jar;D:\maven\local repository\org\glassfish\jersey\media\jersey-media-jaxb\2.25.1\jersey-media-jaxb-2.25.1.jar;D:\maven\local repository\javax\annotation\javax.annotation-api\1.2\javax.annotation-api-1.2.jar;D:\maven\local repository\org\glassfish\hk2\hk2-api\2.5.0-b32\hk2-api-2.5.0-b32.jar;D:\maven\local repository\org\glassfish\hk2\hk2-utils\2.5.0-b32\hk2-utils-2.5.0-b32.jar;D:\maven\local repository\org\glassfish\hk2\external\aopalliance-repackaged\2.5.0-b32\aopalliance-repackaged-2.5.0-b32.jar;D:\maven\local repository\org\glassfish\hk2\external\javax.inject\2.5.0-b32\javax.inject-2.5.0-b32.jar;D:\maven\local repository\org\glassfish\hk2\hk2-locator\2.5.0-b32\hk2-locator-2.5.0-b32.jar;D:\maven\local repository\org\javassist\javassist\3.20.0-GA\javassist-3.20.0-GA.jar;D:\maven\local repository\javax\validation\validation-api\1.1.0.Final\validation-api-1.1.0.Final.jar;D:\maven\local repository\org\glassfish\jersey\containers\jersey-container-servlet-core\2.25.1\jersey-container-servlet-core-2.25.1.jar;D:\maven\local repository\javax\ws\rs\javax.ws.rs-api\2.0.1\javax.ws.rs-api-2.0.1.jar;D:\maven\local repository\org\apache\hbase\hbase-procedure\2.2.4\hbase-procedure-2.2.4.jar;D:\maven\local repository\org\eclipse\jetty\jetty-server\9.3.27.v20190418\jetty-server-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-io\9.3.27.v20190418\jetty-io-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-servlet\9.3.27.v20190418\jetty-servlet-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-webapp\9.3.27.v20190418\jetty-webapp-9.3.27.v20190418.jar;D:\maven\local repository\org\eclipse\jetty\jetty-xml\9.3.27.v20190418\jetty-xml-9.3.27.v20190418.jar;D:\maven\local repository\org\glassfish\web\javax.servlet.jsp\2.3.2\javax.servlet.jsp-2.3.2.jar;D:\maven\local repository\org\glassfish\javax.el\3.0.1-b12\javax.el-3.0.1-b12.jar;D:\maven\local repository\javax\servlet\jsp\javax.servlet.jsp-api\2.3.1\javax.servlet.jsp-api-2.3.1.jar;D:\maven\local repository\org\jamon\jamon-runtime\2.4.1\jamon-runtime-2.4.1.jar;D:\maven\local repository\javax\servlet\javax.servlet-api\3.1.0\javax.servlet-api-3.1.0.jar;D:\maven\local repository\com\lmax\disruptor\3.3.6\disruptor-3.3.6.jar;D:\maven\local repository\org\apache\hadoop\hadoop-distcp\2.8.5\hadoop-distcp-2.8.5.jar;D:\maven\local repository\org\apache\hbase\hbase-replication\2.2.4\hbase-replication-2.2.4.jar;D:\maven\local repository\org\apache\hadoop\hadoop-hdfs\2.8.5\hadoop-hdfs-2.8.5.jar;D:\maven\local repository\commons-daemon\commons-daemon\1.0.13\commons-daemon-1.0.13.jar;D:\maven\local repository\io\netty\netty-all\4.0.23.Final\netty-all-4.0.23.Final.jar;D:\maven\local repository\org\fusesource\leveldbjni\leveldbjni-all\1.8\leveldbjni-all-1.8.jar;D:\maven\local repository\org\apache\hadoop\hadoop-yarn-client\2.8.1\hadoop-yarn-client-2.8.1.jar;D:\Idea 2024\IntelliJ IDEA 2024.3.1.1\lib\idea_rt.jar 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:java.library.path=C:\Program Files\Java\jdk1.8.0_144\bin;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\Program Files\Common Files\Oracle\Java\javapath;D:\soft\bin\;C:\ProgramData\Oracle\Java\javapath;C:\Program Files\Java\jdk1.8.0_144\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\WINDOWS\System32\OpenSSH\;D:\mingw64\bin;D:\anconda\Library\bin;D:\anconda;D:\anconda\Scripts;C:\Program Files\Microsoft VS Code\bin;".;C:\Program Files\Java\jdk1.8.0_144\lib;C:\Program Files\Java\jdk1.8.0_144\lib\tools.jar";D:\node\;D:\node;D:\node\node_cache;D:\node\node_global;C:\ProgramData\chocolatey\bin;D:\Git\Git\cmd;C:\C:\apache-tomcat-10.1.28\bin;C:\C:\apache-tomcat-10.1.28\lib\jsp-api.jar;C:\C:\apache-tomcat-10.1.28\lib\servlet-api.jar;%JAVA-HOME%jre\bin;D:\maven\apache-maven-3.8.5\bin;C:\python\python 3.12.2\Scripts\;C:\python\python 3.12.2\;C:\Program Files\MySQL\MySQL Shell 8.0\bin\;D:\python\Scripts\;D:\python\;C:\Users\缃楁闆╘AppData\Local\Microsoft\WindowsApps;D:\Microsoft VS Code\bin;C:\Program Files\Java\jdk1.8.0_144\bin;D:\Idea 2024\IntelliJ IDEA 2024.3.1.1\bin;;C:\Users\缃楁闆╘AppData\Roaming\npm;D:\Hadoop\hadoop\hadoop-3.3.0\bin;D:\Hadoop\hadoop\hadoop-3.3.0\sbin;D:\Hadoop\hbase-2.6.2\bin;;. 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=C:\Users\236A~1\AppData\Local\Temp\ 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:os.name=Windows 10 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:os.version=10.0 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:user.name=罗欣雨 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:user.home=C:\Users\罗欣雨 2025-06-06 23:34:01,794 INFO zookeeper.ZooKeeper: Client environment:user.dir=D:\code\Hbase_hadoop\HomeWork1 2025-06-06 23:34:01,796 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=luo:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$14/762080652@4f33c470 2025-06-06 23:34:01,825 INFO zookeeper.ClientCnxn: Opening socket connection to server luo/192.168.10.129:2181. Will not attempt to authenticate using SASL (unknown error) 2025-06-06 23:34:01,828 INFO zookeeper.ClientCnxn: Socket connection established to luo/192.168.10.129:2181, initiating session 2025-06-06 23:34:01,839 INFO zookeeper.ClientCnxn: Session establishment complete on server luo/192.168.10.129:2181, sessionid = 0x1974500ed1b0030, negotiated timeout = 90000 Exception in thread "main" java.io.IOException: The ownership on the staging directory /tmp/hadoop-yarn/staging/罗欣雨/.staging is not as expected. It is owned by ???. The directory must be owned by the submitter 罗欣雨 or by 罗欣雨 at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:120) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:146) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1341) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1338) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1844) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1338) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359) at org.example.HBaseMapreduce.BrandAmount.main(BrandAmount.java:67) Process finished with exit code 1
06-07
SQL 错误 [1] [08S01]: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Permission denied: user=anonymous, access=EXECUTE, inode="/tmp":root:supergroup:drwx------ at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:350) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:311) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:238) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:189) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1753) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1737) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkOwner(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirAttrOp.setPermission(FSDirAttrOp.java:64) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.setPermission(FSNamesystem.java:1781) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.setPermission(NameNodeRpcServer.java:830) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.setPermission(ClientNamenodeProtocolServerSideTranslatorPB.java:469) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:503) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:871) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:817) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2606) at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:257) at org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:348) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:362) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=anonymous, access=EXECUTE, inode="/tmp":root:supergroup:drwx------ at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:350) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:311) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:238) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:189) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1753) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1737) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkOwner(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirAttrOp.setPermission(FSDirAttrOp.java:64) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.setPermission(FSNamesystem.java:1781) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.setPermission(NameNodeRpcServer.java:830) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.setPermission(ClientNamenodeProtocolServerSideTranslatorPB.java:469) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:503) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:871) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:817) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2606)
06-19
评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值