Hive 报错 java.lang.RuntimeException: Error in configuring object

Hive缺少lzo依赖问题解决
最新推荐文章于 2023-10-26 16:58:21 发布
原创 最新推荐文章于 2023-10-26 16:58:21 发布 · 2.3k 阅读 · 1 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
文章标签：

#hive

本文介绍了一个常见的Hive运行错误，原因是Hive的依赖库中缺失了lzo的jar包。通过将hadoop-lzo-0.4.20.jar复制到${HIVE_HOME}

查看日志后发现错误原因：

Hive的依赖库中缺少lzo的jar包。

解决办法：

把lzo的jar包放到${HIVE_HOME}/lib目录下。

cp hadoop-lzo-0.4.20.jar ${HIVE_HOME}/lib

再次执行HiveSQL，发现错误已经解决。

Hive-java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe
qq_38304392的博客
05-27 783
Task with the most failures(4): ----- Task ID: task_1555476136794_8201_m_000000 URL: http://hadoop1:8088/taskdetails.jsp?jobid=job_1555476136794_8201&tipid=task_1555476136794_8201_m_000000...
Hive Error in configuring object Caused by: java.lang.reflect.InvocationTargetException
weixin_46784562的博客
08-13 1931
报错日志 在一次Hive任务中出现报错，查看yarn日志如下，由于网上没有搜到解决办法，所以自己在官方issue中找到解决办法并记录下 2021-07-31 14:23:11,467 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.Reflect
hive脚本出现Error: java.lang.RuntimeException: Error in configuring object和Caused by: java.lang.IndexOut...
weixin_33738555的博客
06-12 3447
是在reduce阶段报的错误，详细错误信息是 朱传豪 19:04:48 Diagnostic Messages for this Task: Error: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(Refle...
hive相关错误:java.lang.RuntimeException: Error in configuring object
HAHA的专栏
03-27 5775
hive相关错误:java.lang.RuntimeException: Error in configuring object     今天在hive中运行了select count(1) from track_log where date='20150828' and hour='19' ;这条命令，却出现了如下的错误。      感觉很难受啊，上面说配置的问题产生
hive1.2.1版本装载数据报错Error: java.lang.RuntimeException: Error in configuring object
qq_57096334的博客
10-26 481
解决方法：向hive命令行中添加hive-hcatalog-core-1.2.1.jar包。从日志看是缺少了包二导致的。
解决Failed with exception java.io.IOException:java.lang.RuntimeException: Error in configuring object
qq_40772429的博客
08-05 2089
很多天没用hive了,今天启动的时候就报一个:Failed with exception java.io.IOException:java.lang.RuntimeException: Error in configuring object 根据错误信息描述,应该是配置文件的问题,可以查看hadoop的四大配置文件 发现是在core.site.xml文件中配置了lzo压缩,删除后即可解决问题,保存后分发至集群各机器,重启集群即可. ...
Failed with exception java.io.IOException:java.lang.RuntimeException: Error in configuring object
weixin_43586713的博客
06-19 3235
原本之前的虚拟机还是好好的,Hive能够正常使用.这两天HIVE在执行select查询语句的时候,突然遇到了这个报错.Failed with exception java.io.IOException:java.lang.RuntimeException: Error in configuring object 从字面上翻译是配置文件错误,但是也没有说明到底是哪个配置文件错误.想改也无从下手.于是乎,到/opt/module/hive/conf/logs/hive.log下去查找报错的原因: java.io
Hive: java.lang.ClassNotFoundException Class org.apache.hive.hcatalog.data.JsonSerDe not found
砍柴人的博客
02-25 1028
WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. Query ID = root_20210225123435_1324c293-cd8b-42be-802d-339619ddd885 Tot..
[root@node01 spark-2.2.0]# WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. Query ID = root_20250618171546_98bf4b6f-b177-46be-bd90-5d5709254c46 Total jobs = 1 Launching Job 1 out of 1 Number of reduce tasks is set to 0 since there's no reduce operator Starting Job = job_1750230990893_0006, Tracking URL = http://node01:8088/proxy/application_1750230990893_0006/ Kill Command = /opt/software/hadoop/hadoop-2.9.2/bin/hadoop job -kill job_1750230990893_0006 Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0 2025-06-18 17:16:10,142 Stage-1 map = 0%, reduce = 0% 2025-06-18 17:16:56,669 Stage-1 map = 100%, reduce = 0% Ended Job = job_1750230990893_0006 with errors Error during job, obtaining debugging information... Examining task ID: task_1750230990893_0006_m_000000 (and more) from job job_1750230990893_0006 Task with the most failures(4): ----- Task ID: task_1750230990893_0006_m_000000 URL: http://node01:8088/taskdetails.jsp?jobid=job_1750230990893_0006&tipid=task_1750230990893_0006_m_000000 ----- Diagnostic Messages for this Task: Error: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:113) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:455) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:177) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:171) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110) ... 9 more Caused by: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:113) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38) ... 14 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110) ... 17 more Caused by: java.lang.RuntimeException: Map operator initialization failed at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:125) ... 22 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: Class org.apache.hive.hcatalog.data.JsonSerDe not found at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:328) at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:420) at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:94) ... 22 more Caused by: java.lang.ClassNotFoundException: Class org.apache.hive.hcatalog.data.JsonSerDe not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2299) at org.apache.hadoop.hive.ql.plan.PartitionDesc.getDeserializer(PartitionDesc.java:177) at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:295) ... 24 more FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Stage-Stage-1: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL Total MapReduce CPU Time Spent: 0 msec
06-19
在Hive任务执行过程中，出现`java.lang.ClassNotFoundException: Class org.apache.hive.hcatalog.data.JsonSerDe not found`错误的主要原因是Hive在运行时未能正确加载用于解析JSON格式数据的`JsonSerDe`类。...
presto 查询hive facebook.presto.spi.PrestoException: ....hadoop.mapred.TextInputFormat
06-15 1218
om.facebook.presto.spi.PrestoException: Unable to create input format org.apache.hadoop.mapred.TextInputFormat at com.facebook.presto.hive.HiveUtil.getInputFormat(HiveUtil.java:331) at com.facebook.presto.hive.StoragePartitionLoader.loadPartition(Storage
hive跑mapreduce报java.lang.RuntimeException: Error in configuring object
weixin_30765475的博客
07-15 1700
写于2016.7月 最近项目需要在hbase上做统计分析，在本机上装了hive，结果跑小批量数据sum时报错： hive> select count(*) from page_view; Total jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at compile time: ...
nutch java.lang.RuntimeException: Error in configuring object错误解决
笔记
02-19 929
右键工程properties, 切换到"Libraries"选择"Add Class Folder..." 按钮，从列表中选择"conf". 将 conf加入到classpath中。
Hive中报错Error in configuring object，InvocationTargetException，Map operator initialization failed可能原因
weixin_51913486的博客
08-25 767
Hive报错java.lang.reflect.InvocationTargetException,Error in configuring object,InvocationTargetException,Map operator initialization failed,Unsupported complex type: MAP
hive报错FAILED: HiveException java.lang.RuntimeException
weixin_44168245的博客
02-22 5598
hive> show databases; 报错FAILED: HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient 首先初始化MySQL数据库schematool -dbType mysql -initSchema，报错发现MySQL之前有创建过hive数据库，将它删了，在初始化MySQL数据库后因为hi
Hive执行查询报错：Caused by: java.lang.RuntimeException: Hive Runtime Error while closing operators
youhaitao_do的博客
12-01 3755
1、问题描述 2、解决办法： 在查询前加上： set hive.vectorized.execution.enabled=false; -- 控制是否启用查询执行的向量模式
Plugins: directory not found: plugins java.lang.RuntimeException: Error in confi
aa346359669的博客
01-08 2143
Plugins: directory not found: plugins java.lang.RuntimeException: Error in configuring object 在nutch-site.xml中添加: [code="java"] plugin.folders apache-nutch-1.6\src\plugin [/code] ...
Hive执行查询报错：Caused by: java.lang.RuntimeException: Hive Runtime Error while closing operators: org.
weixin_43158878的博客
07-01 3906
Hive执行查询报错：Caused by: java.lang.RuntimeException: Hive Runtime Error while closing operators: org.apache.hadoop.hive.ql.metadata.HiveException: Column vector class org.apache.hadoop.hive.ql.exec.vecto...
关于hive初始化时遇到HiveException java. lang. RuntimeException的问题
qq_35472225的博客
05-30 2633
前言 hive初始化时遇到HiveException java. lang. RuntimeException报错，多半是因为你粗心大意，好好检查一下配置文件 一、重新检查配置文件 示例：找到你的hive-site.xml文件 vim $HIVE_HOME/conf/hive-site.xml 查看你的配置文件 <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <
java.lang.RuntimeException: java.lang.RuntimeException: Unsupported output type: NULL
最新发布
08-05
在处理 Java 异常和日期解析时，如果遇到 `java.lang.RuntimeException: Unsupported output type: NULL`，通常表明某个框架或库在尝试处理空值（`NULL`）作为输出时未能正确处理，尤其是在涉及数据类型转换或序列化...
评论 2
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

訾尤

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值