sqoop抽取数据报错 Zero date value prohibited

原创

于 2024-10-31 21:03:31 发布 · 301 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#sqoop #hadoop #hive

#sqoop抽取数据报错 Zero date value prohibited

修改前sqoop抽数脚本如下:
${sqoop_home}/sqoop import -Dorg.apache.sqoop.splitter.allow_text_splitter=true \
-D mapreduce.map.memory.mb=4096 \
-D mapreduce.reduce.memory.mb=4096 \
--connect "${ip_port}" \
--username "${username}" \
--password "${password}" \
--driver com.oceanbase.jdbc.Driver \
--fields-terminated-by '|' \
--null-string '\\N' \
--null-non-string '\\N' \
--hive-delims-replacement ' ' \
--outdir /tpdata/data/sqoopcode \
--delete-target-dir \
--fetch-size 200 \
--map-column-hive ${fields_string}=String \
--target-dir /user/hive/warehouse/dlk_tpprty_ods_new.db/${table_name}/etl_date=$etldate  \
--query "${query_sql} " \
-m 1  >> ${sqoop_error_file} 2>&1

报错如下:
Error: java.io.IOException: SQLException in nextKeyValue
        at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:569)