1、静态 Executor 数量分配(禁用动态分配)
spark.dynamicAllocation.enabled=false
spark.executor.instances=16
2、动态资源分配(启用动态分配)
spark.dynamicAllocation.enabled=true
spark.dynamicAllocation.maxExecutors=16
spark.dynamicAllocation.minExecutors=1
1、静态 Executor 数量分配(禁用动态分配)
spark.dynamicAllocation.enabled=false
spark.executor.instances=16
2、动态资源分配(启用动态分配)
spark.dynamicAllocation.enabled=true
spark.dynamicAllocation.maxExecutors=16
spark.dynamicAllocation.minExecutors=1