Job aborted due to stage failure: Total size of serialized results of 31 tasks (1043.8 MB) is bigger

spark.driver.maxResultSize太小导致的错误

Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Total size of serialized results of 31 tasks (1043.8 MB) is bigger than spark.driver.maxResultSize (1024.0 MB)
at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1283)