安装Anaconda
在continuum上下载Anaconda2-2.5.0 for Linux
终端命令行:
wget https://repo.continuum.io/archive/Anaconda2-2.5.0-Linux-x86_64.sh
bash Anaconda2-2.5.0-Linux-x86_64.sh -b
-b 指batch,批次安装,自动省略阅读License条款,自动安装至/home/用户名/anaconda2路径
编辑 ~/.bashrc加入模块路径
sudo gedit ~/.bashrc
将Anaconda加入路径,在bashrc中键入:
export PATH=/home/本机用户名/anaconda2/bin:$PATH
export ANACONDA_PATH=/home/本机用户名/anaconda2
设置pyspark
export PYSPARK_DRIVER_PYTHON=$ANACONDA_PATH/bin/ipython
export PYSPARK_PYTHON=