47.Spark Thrift的启用——CDH

47.1 演示环境

• CM和CDH版本是5.13.0
• Spark1.6.0 On Yarn模式
• root用户操作

47.2 操作演示

部署Spark-assembly Jar包

• 下载spark-1.6.3-bin-hadoop2.6.tgz，下载地址如下：

https://www.apache.org/dyn/closer.lua/spark/spark-1.6.3/spark-1.6.3-bin-hadoop2.6.tgz

• 将下载的spark-1.6.3-bin-hadoop2.6.tgz上传至集群的任意节点并解压，这里以cdh02节点为例

[root@cdh02 ~]# tar -zxvf spark-1.6.3-bin-hadoop2.6.tgz 

• 将解压出来的spark-assembly-1.6.3-hadoop2.6.0.jar拷贝至CDH的jars目录

<pre style="margin: 0px; padding: 0px; max-width: 100%; box-sizing: border-box !important; overflow-wrap: break-word !important; color: rgb(51, 51, 51); font-size: 17px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: 0.544px; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial; background-color: rgb(202, 230, 202);">[root@cdh02 spark-1.6.3-bin-hadoop2.6]# scp /root/spark-1.6.3-bin-hadoop2.6/lib/spark-assembly-1.6.3-hadoop2.6.0.jar /opt/cloudera/parcels/CDH/jars/</pre>

• 替换CDH中spark默认的spark-assembly jar包

<pre style="margin: 0px; padding: 0px; max-width: 100%; box-sizing: border-box !important; overflow-wrap: break-word !important; color: rgb(51, 51, 51); font-size: 17px; font-style: normal; font-variant-ligatures: normal; font-var