1.Your first data program in PySpark
Data-driven applications, no matter how complex, all boil down to what we can
think of as three meta steps, which are easy to distinguish in a program:
1 We start by loading or reading the data we wish to work with.
2 We transform the data, either via a few simple instructions or a very complex
machine learning model.
3 We then export (or sink) the resulting data, either into a file or by summariz-
ing our findings into a visualization.
NOTE REPL stands for read, evaluate, print, and loop. In the case of Python, it represents the interactive prompt in which we input commands and read results.