Marsm的博客

编译spark 2.1.0源码 准备环境： 准备spark源码包:https://archive.apache.org/dist/spark/spark-2.1.0/spark-2.1.0.tgz 准备maven-3.3.9以上 scala-2.11.8:https://downloads.lightbend.com/scala/2.11.8/scala-2.11.8.tgz 设置mavn...

CDH 5.16.1集群环境搭建 集群节点 192.168.10.1 hadoop01 235G+4T 192.168.10.2 hadoop02 235G+4T 192.168.10.3 hadoop03 235G+4T 192.168.10.4 hadoop04 235G+4T 集群节点初始化 1.配置节点hosts 192.168.10.1 hadoop01.office.gdapi....

windows+pycharm搭建spark开发环境 创建python文件 点击 file >> setting >> Project:PythonProject >> Prohject Structure 添加pyspark.zip和py4j包到项目中（这两个文件在spark安装包的D:\apps\spark-2.3.2-bin-hadoop2.7\pyt...