mysql的数据导入到hive表timestamp值异常问题解决

最新推荐文章于 2025-01-13 14:12:46 发布

yekanghui

最新推荐文章于 2025-01-13 14:12:46 发布

阅读量2.7k

点赞数

分类专栏：大数据

本文链接：https://blog.youkuaiyun.com/aizhenshi/article/details/81634061

版权

在将MySQL数据导入Hive时遇到错误，源于timestamp字段包含'0000-00-00 00:00:00'值。通过在jdbc连接字符串中添加'zeroDateTimeBehavior=convertToNull'参数，可以成功解决这个问题，避免IOException。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

mysql的数据导入到hive表中报错:

Error: java.io.IOException: SQLException in nextKeyValue
   at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
   at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:562)
   at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
   at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
   at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
   at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
   at java.security.AccessController.doPrivileged(Native Method)
   at javax.security.auth.Subject.doAs(Subject.java