bin/sqoop import \
> --connect jdbc:mysql://192.168.249.161:3306/nev \
> --username hive \
> --password hive \
> --query "select
> id,create_date_time,session_id,sid,create_time,seo_source,seo_keywords,ip,area,
> country,province,city,origin_channel,user as
> user_match,manual_time,begin_time,end_time,last_customer_msg_time_stamp,last_agent_msg_time_stamp, reply_msg_count,msg_count,browser_name,os_info from
> web_chat_ems_2019_07 where 1=1 and \$CONDITIONS" \
> --hcatalog-database hnsoft_ods \
> --hcatalog-table web_chat_ems_ods \
> -m 2 \
> --split-by id
Warning: /home/hadoop/app/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/app/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/app/hadoop-2.9.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/app/hbase-1.2.0/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
25/05/28 14:51:28 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
25/05/28 14:51:28 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
25/05/28 14:51:28 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
25/05/28 14:51:28 INFO tool.CodeGenTool: Beginning code generation
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
25/05/28 14:51:29 INFO manager.SqlManager: Executing SQL statement: select
id,create_date_time,session_id,sid,create_time,seo_source,seo_keywords,ip,area,
country,province,city,origin_channel,user as
user_match,manual_time,begin_time,end_time,last_customer_msg_time_stamp,last_agent_msg_time_stamp, reply_msg_count,msg_count,browser_name,os_info from
web_chat_ems_2019_07 where 1=1 and (1 = 0)
25/05/28 14:51:30 INFO manager.SqlManager: Executing SQL statement: select
id,create_date_time,session_id,sid,create_time,seo_source,seo_keywords,ip,area,
country,province,city,origin_channel,user as
user_match,manual_time,begin_time,end_time,last_customer_msg_time_stamp,last_agent_msg_time_stamp, reply_msg_count,msg_count,browser_name,os_info from
web_chat_ems_2019_07 where 1=1 and (1 = 0)
25/05/28 14:51:30 INFO manager.SqlManager: Executing SQL statement: select
id,create_date_time,session_id,sid,create_time,seo_source,seo_keywords,ip,area,
country,province,city,origin_channel,user as
user_match,manual_time,begin_time,end_time,last_customer_msg_time_stamp,last_agent_msg_time_stamp, reply_msg_count,msg_count,browser_name,os_info from
web_chat_ems_2019_07 where 1=1 and (1 = 0)
25/05/28 14:51:30 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/hadoop/app/hadoop
注: /tmp/sqoop-root/compile/413c3b2426f9b2007f8209241e804082/QueryResult.java使用或覆盖了已过时的 API。
注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
25/05/28 14:51:41 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/413c3b2426f9b2007f8209241e804082/QueryResult.jar
25/05/28 14:51:41 INFO mapreduce.ImportJobBase: Beginning query import.
25/05/28 14:51:41 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hive/hcatalog/mapreduce/HCatOutputFormat
at org.apache.sqoop.mapreduce.DataDrivenImportJob.getOutputFormatClass(DataDrivenImportJob.java:178)
at org.apache.sqoop.mapreduce.ImportJobBase.configureOutputFormat(ImportJobBase.java:94)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:259)
at org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:729)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:499)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
Caused by: java.lang.ClassNotFoundException: org.apache.hive.hcatalog.mapreduce.HCatOutputFormat
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 12 more
最新发布
博客内容讲述了在多版本Go环境中遇到的编译错误问题，以及如何通过确认并更新GOROOT和bin路径来解决该问题。建议使用cp命令替换旧版本，确保新版本覆盖旧版本内容，最终成功编译。
扫一扫
1680
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
