术业有专攻

https://spark.apache.org/docs/latest/cluster-overview.html   This document gives a short overview of how Spark runs on clusters, to make it easier to understand the components involved. Read throug...

Host: 192.168.0.135 192.168.0.136   192.168.0.137 master: 137  workers:135 136   1.Install spark on all hosts  in /opt dir   2.Install SSH Remote Access 137#ssh-keygen 137#ssh-copy-id -i ~/.s...

In distributed mode, Spark uses a master/slave  architecture with one central  coordinator and many distributed  workers. The central coordinator is called the driver.The driver communicates with a p...

Spark Streaming uses a “micro-batch” architecture, where the streaming computation is treated as a continuous series of batch computations on small batches of data. Spark Streaming receives data fro...