spark streaming
关注
分享
扫一扫
瓦力冫
喜欢看点书，跑跑步，热爱游戏编程
展开
-
spark streaming networkwordcount
package com.immooc.sparkimport org.apache.spark.SparkConfimport org.apache.spark.storage.StorageLevelimport org.apache.spark.streaming.{Seconds, StreamingContext}object NetworkWordCount { de...原创 2018-06-19 17:52:43 · 324 阅读 · 0 评论 -
spark streaming 文件系统
package com.immooc.sparkimport org.apache.spark.SparkConfimport org.apache.spark.storage.StorageLevelimport org.apache.spark.streaming.{Seconds, StreamingContext}object FileWordCount { def mai...原创 2018-06-19 17:54:47 · 299 阅读 · 0 评论 -
spark streaming foreachRDD 使用
package com.immooc.sparkimport java.sql.DriverManagerimport org.apache.spark.SparkConfimport org.apache.spark.streaming.{Seconds, StreamingContext}object ForeachRDDApp { def main(args: Array[...原创 2018-06-19 17:56:16 · 615 阅读 · 0 评论 -
spark streaming 中使用 spark sql
package com.immooc.sparkimport org.apache.spark.{SparkConf, rdd}import org.apache.spark.rdd.RDDimport org.apache.spark.storage.StorageLevelimport org.apache.spark.streaming.{Seconds, StreamingCon...原创 2018-06-19 18:06:25 · 2322 阅读 · 1 评论 -
spark streaming kafka 整合
package com.test.sparkimport org.apache.kafka.clients.consumer.ConsumerRecordimport org.apache.kafka.common.serialization.StringDeserializerimport org.apache.spark.SparkConfimport org.apache.spark...原创 2018-06-19 18:20:47 · 321 阅读 · 0 评论