
spark streaming
瓦力冫
喜欢看点书,跑跑步,热爱游戏编程
展开
专栏收录文章
- 默认排序
- 最新发布
- 最早发布
- 最多阅读
- 最少阅读
-
spark streaming networkwordcount
package com.immooc.spark import org.apache.spark.SparkConf import org.apache.spark.storage.StorageLevel import org.apache.spark.streaming.{Seconds, StreamingContext} object NetworkWordCount { de...原创 2018-06-19 17:52:43 · 333 阅读 · 0 评论 -
spark streaming 文件系统
package com.immooc.spark import org.apache.spark.SparkConf import org.apache.spark.storage.StorageLevel import org.apache.spark.streaming.{Seconds, StreamingContext} object FileWordCount { def mai...原创 2018-06-19 17:54:47 · 312 阅读 · 0 评论 -
spark streaming foreachRDD 使用
package com.immooc.spark import java.sql.DriverManager import org.apache.spark.SparkConf import org.apache.spark.streaming.{Seconds, StreamingContext} object ForeachRDDApp { def main(args: Array[...原创 2018-06-19 17:56:16 · 624 阅读 · 0 评论 -
spark streaming 中使用 spark sql
package com.immooc.spark import org.apache.spark.{SparkConf, rdd} import org.apache.spark.rdd.RDD import org.apache.spark.storage.StorageLevel import org.apache.spark.streaming.{Seconds, StreamingCon...原创 2018-06-19 18:06:25 · 2333 阅读 · 1 评论 -
spark streaming kafka 整合
package com.test.spark import org.apache.kafka.clients.consumer.ConsumerRecord import org.apache.kafka.common.serialization.StringDeserializer import org.apache.spark.SparkConf import org.apache.spark...原创 2018-06-19 18:20:47 · 329 阅读 · 0 评论