org.apache.doris.spark.exception.DorisException: Spark type is DATEV2, but arrow type is DATEDAY

SunnyRivers

于 2024-08-08 11:09:57 发布

阅读量330

点赞数

CC 4.0 BY-SA版权

分类专栏：分析别人的Bug让自己“零”Bug 文章标签： spark doris dorisexception type date

本文链接：https://blog.youkuaiyun.com/Android_xue/article/details/141020369

分析别人的Bug让自己“零”Bug 专栏收录该内容

15 篇文章 ¥9.90 ¥99.00

订阅专栏

超级会员免费看

在这里插入图片描述

bug信息

Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 17.0 failed 4 times, most recent failure: Lost task 1.3 in stage 17.0 (TID 818, worker35-cdp03.byd.com, executor 17): org.apache.doris.spark.exception.DorisException: Spark type is DATEV2, but arrow type is DATEDAY.
	at org.apache.doris.spark.serialization.RowBatch.<init>(RowBatch.java:127)
	at org.apache.doris.spark.rdd.ScalaValueReader.hasNext(ScalaValueReader.scala:210)
	at org.apache.doris.spark.rdd.AbstractDorisRDDIterator.hasNext(AbstractDorisRDDIterator.scala:56)
	at scala.collection.Iterator$$anon$1