Caused by: java.lang.IllegalArgumentException: Can't zip RDDs with unequal numbers of partitions: List(1, 200)
处理方式:
关闭AQE: set spark.sql.adaptive.enabled = false;
本文介绍了一种常见错误:由于RDD分区数量不等导致的java.lang.IllegalArgumentException异常,并提供了解决方案——通过设置spark.sql.adaptive.enabled参数为false来关闭自适应查询执行。
Caused by: java.lang.IllegalArgumentException: Can't zip RDDs with unequal numbers of partitions: List(1, 200)
处理方式:
关闭AQE: set spark.sql.adaptive.enabled = false;
4869
910
2137
1625
788

被折叠的 条评论
为什么被折叠?