1. Requirements for Mac
Name | Description | Installation Guide |
---|---|---|
Brew | The package installation soft for mac. Very helpful for this installation and in life in general. | |
Anaconda | A distribution of python, with packaged modules and libraries. Note: we recommend installing Anaconda 2 (for python 2.7) | |
JDK 8 | Java Development Kit, used in both Hadoop and Spark. |
|
在安装brew的时候如果出现报错:
curl: (7) Failed to connect to raw.githubusercontent.com port 443: Connection refused
解决方案:如果能打开这个网页,https://raw.githubusercontent.com/Homebrew/install/master/install,将网页保存为brew_install.rb后,命令行进去该文件路径输入如下命令即可完成安装。
ruby brew_install.rb
2. 安装scala
brew install scala
3.安装spark
brew install apache-spark
4.启动
spark-shell