大数据sqoop抽取数据到hive遇到的问题 java.lang.ClassNotFoundException: org.apache.hadoop.hive.conf.HiveConf

最新推荐文章于 2024-08-03 14:21:47 发布

原创最新推荐文章于 2024-08-03 14:21:47 发布 · 451 阅读

1 ·

CC 4.0 BY-SA版权

文章标签：

#sqoop #hive

本文解决了一个常见问题：使用sqoop从MySQL导入数据到Hive时出现的ClassNotFoundException错误。详细介绍了错误的原因及解决方案，即通过将hive-common-3.0.0.jar包从Hive的lib目录复制到sqoop的lib目录来修复此问题。

大数据sqoop抽取数据到hive遇到的问题

ERROR tool.ImportTool: Import failed: java.io.IOException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.conf.HiveConf

sqoop从mysql导入到hive报错：

20/09/08 13:30:53 ERROR tool.ImportTool: Import failed: java.io.IOException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.conf.HiveConf
        at org.apache.sqoop.hive.HiveConfig.getHiveConf(HiveConfig.java:50)
        at org.apache.sqoop.hive.HiveImport.getHiveArgs(HiveImport.java:392)
        at org.apache.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:379)
        at org.apache.sqoop.hive.HiveImport.executeScript(HiveImport.java:337)
        at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:241)
        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:537)
        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.conf.HiveConf
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at org.apache.sqoop.hive.HiveConfig.getHiveConf(HiveConfig.java:44)
        ... 12 more

原因：缺少了hive-common-3.0.0.jar包，在hive的lib目录下，拷贝到sqoop的lib目录下即可。

ps：jar包的版本根据hive的安装lib的版本复制就可以