
spark
文章平均质量分 79
Pushkin.
life feeds on negative entropy
展开
-
Spark优化-开启动态资源分配
Spark资源动态分配,性能优化原创 2022-08-22 23:22:15 · 1241 阅读 · 7 评论 -
java.lang.IllegalArgumentException : System memory 259522560 must be at least 471859200.
Exception in thread "main" java.lang.IllegalArgumentException: System memory 259522560 must be at least 471859200. Please increase heap size using the --driver-memory option or spark.driver.memory in原创 2017-10-10 10:10:27 · 4106 阅读 · 0 评论 -
spark读取hdfs异常记录
spark读取hdfs异常记录 java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.原创 2017-11-23 16:28:03 · 1464 阅读 · 1 评论