weixin_43015677的博客

val spark = SparkSession.builder().master("local[*]").appName(this.getClass.getSimpleName).getOrCreate() val sc = spark.sparkContext val fs = FileSystem.get(sc.hadoopConfiguration) sc.setLogLevel("error") import spark.implicits._ v..

case class Testtt(name:String,age:String)object TestDay { def main(args: Array[String]): Unit = { val map = new mutable.HashMap[String, String]() map.put("name","小明") map.put("age","20") println(createCaseClass[Testtt](map)) } .

问题：scala语言spark将数据转成一个json写出去的时候，写出的文件中出现{ “empty”:false, “traversableAgain”:true }原因：JSON.toJSONString(map）转为string时出现问题，转为java的集合类就可以了JSON.toJSONString(map.asJava）//导包import collection.JavaConverters._...

报错内容Error:(87, 13) ambiguous reference to overloaded definition,both method toJSONString in object JSON of type (x$1: Any, x$2: com.alibaba.fastjson.serializer.SerializerFeature*)Stringand method toJSONString in object JSON of type (x$1: Any)Stringmat

代码中使用了两次1.第一次使用val fs = FileSystem.get(sparkSession.sparkContext.hadoopConfiguration)第二次使用2.sparkSession.sparkContext.parallelize(list)改为下述一次生成，多次调用：va sc=sparkSession.sparkContextval fs = File...

将字符串转换为时间戳 def coverStringTimeToLong(time:String): Long ={ val format = DateTimeFormatter.ofPattern("yyyy-MM-dd HH:mm:ss") val parse = LocalDateTime.parse(time, format) //getEpochSecond...