Sqoop报错-Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR is correctly

最新推荐文章于 2024-07-10 15:39:00 发布

JP-Destiny

最新推荐文章于 2024-07-10 15:39:00 发布

阅读量1.3k

点赞数

CC 4.0 BY-SA版权

分类专栏：大数据文章标签： Sqoop报错 Could not load hive.conf.HiveConf Make sure HIVE_CONF_DIR is set corr

本文链接：https://blog.youkuaiyun.com/JavaDestiny/article/details/89684105

大数据专栏收录该内容

62 篇文章

订阅专栏

本文详细描述了在使用Sqoop将数据从MySQL导入Hive时遇到的问题，即无法加载org.apache.hadoop.hive.conf.HiveConf。文章提供了具体的错误信息，并给出了在/etc/profile文件中配置HIVE_CONF_DIR和HADOOP_CLASSPATH的解决方案。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Issue

19/04/29 21:34:31 ERROR hive.HiveConfig: Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR is set correctly.
19/04/29 21:34:31 ERROR tool.ImportTool: Import failed: java.io.IOException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.conf.HiveConf
	at org.apache.sqoop.hive.HiveConfig.getHiveConf(HiveConfig.java:50)
	at org.apache.sqoop.hive.HiveImport.getHiveArgs(HiveImport.java:392)
	at org.apache.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:379)
	at org.apache.sqoop.hive.HiveImport.executeScript(HiveImport.java:337)
	at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:241)
	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:537)
	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
	at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
	at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

在这里插入图片描述

Answer

在Sqoop-MySQL导入到Hive中，无法加载org.apache.hadoop.hive.conf.HiveConf，确保正确设置HIVE_CONF_DIR

在/etc/profile文件里配置HIVE_CONF_DIR和HADOOP_CLASSPATH

export HIVE_CONF_DIR=/usr/local/hive/apache-hive-2.3.4/conf
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$HIVE_HOME/lib/*

在这里插入图片描述