Marsm的博客

编译spark 2.1.0源码准备环境：准备spark源码包:https://archive.apache.org/dist/spark/spark-2.1.0/spark-2.1.0.tgz准备maven-3.3.9以上scala-2.11.8:https://downloads.lightbend.com/scala/2.11.8/scala-2.11.8.tgz设置mavn...

CDH 5.16.1集群环境搭建集群节点192.168.10.1 hadoop01 235G+4T192.168.10.2 hadoop02 235G+4T192.168.10.3 hadoop03 235G+4T192.168.10.4 hadoop04 235G+4T集群节点初始化1.配置节点hosts192.168.10.1 hadoop01.office.gdapi....

windows+pycharm搭建spark开发环境创建python文件点击 file >> setting >> Project:PythonProject >> Prohject Structure添加pyspark.zip和py4j包到项目中（这两个文件在spark安装包的D:\apps\spark-2.3.2-bin-hadoop2.7\pyt...