Spark Streaming(2)Old Notes

Spark Streaming(2)Old Notes

1. Data Flow
Input Data Stream ——> Spark Streaming ——> batches of input data ——>Spark Engine ——>Batches of Processed Data


Tip:
Last spark can be build by this command
> build/mvn -DskipTests clean package

References:
http://sillycat.iteye.com/blog/2215237

http://uohzoaix.github.io/studies/categories/#spark

spark streaming
http://dataunion.org/15193.html
http://dataunion.org/6308.html
http://colobu.com/2015/01/05/kafka-spark-streaming-integration-summary/

https://spark.apache.org/docs/latest/streaming-programming-guide.html

http://colobu.com/2015/01/05/kafka-spark-streaming-integration-summary/