hive直接查询hbase库错误

最新推荐文章于 2021-12-23 23:25:46 发布

原创最新推荐文章于 2021-12-23 23:25:46 发布 · 469 阅读

0 ·

CC 4.0 BY-SA版权

hive 专栏收录该内容

2 篇文章

订阅专栏

本文详细解析了在使用Hadoop HBase时遇到的java.io.IOException异常，具体为NoSuchMethodError错误，涉及ClientProtos$ScanRequest$Builder类的setRenew方法。文章提供了有效的解决方案，建议从数据仓库直接查询而非通过HBase映射库，避免此类问题。

错误描述

Error: java.io.IOException: org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest$Builder.setRenew(Z)Lorg/apache/hadoop/hbase/protobuf/generated/ClientProtos$ScanRequest$Builder;
at org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderNextException(HiveIOExceptionHandlerChain.java:121)
at org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderNextException(HiveIOExceptionHandlerUtil.java:77)
at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:365)
at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:79)
at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:33)
at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:116)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:199)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:185)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:52)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1727)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest$Builder.setRenew(Z)Lorg/apache/hadoop/hbase/protobuf/generated/Cl
▽
ientProtos$ScanRequest$Builder;
▽
at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateException(RpcRetryingCaller.java:239)

解决办法：从数据仓库里面查询，不要从hbase映射库查询。