
Spark
.
ypp91zr
善于分享,提升自我!
展开
-
Spark读取mysql数据
public void getStudentName() throws IOException { Properties properties = new Properties(); properties.put("driver", ApplicationYmlUtils.getDataSourceDriverClassName()); properties.put("user", ApplicationYmlUtils.getDataSourceUsern.原创 2020-08-31 17:47:02 · 1415 阅读 · 0 评论 -
org.apache.spark.SparkException: Task not serializable
Spark报错:org.apache.spark.SparkException: Task not serializable一眼就能看出是没有进行序列化,在spark程序中,所有的class都要序列化。如果不需要序列化的用transient修饰修改后的代码:package com.example.controller;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaRDD;原创 2020-05-25 18:09:33 · 470 阅读 · 0 评论