How-to: enable spark sql in cdh version spark

Cloudera spark does not support sparksql. Here, I will take cdh-5.4.1 spark as example to enabled sparkSql.

The overall steps wil be update hive version, resolve compile issue and update spark package.

1. Update hive version: cdh 5.4.1 is using hive1.1, while current apache spark only support hive0.12 and hive0.13. Here update hive version to 0.13.1a:
   pom.xml:
   -    <hive.group>org.apache.hive</hive.group>
   +    <hive.group>org.spark-project.hive</hive.group>
   -    <hive.version>${cdh.hive.version}</hive.version>
   +    <hive.version>0.13.1a</hive.version>
   -    <hive.version.short>1.1.0</hive.version.short>
   +    <hive.version.short>0.13.1</hive.version.short>
        <profile>
          <id>hive-0.13.1</id>
          <properties>
   +        <hive.group>org.spark-project.hive</hive.group>
            <hive.version>0.13.1a</hive.version>
2. Resolve compile issues: 
   pom.xml:
   +        <groupId>jline</groupId>
   +        <artifactId>jline</artifactId>
   +        <version>0.9.94</version>
   +      </dependency>
   +      <dependency>
    sql/hive-thriftserver/pom.xml
   +    <dependency>
   +      <groupId>jline</groupId>
   +      <artifactId>jline</artifactId>
   +      <version>0.9.94</version>
   +    </dependency>
   sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLSessionManager.scala
   -    // SessionManager.init() initializes the log manager but this method never actually calls
   -    // super.init(), so fix that here.
   -    val logManager = new LogManager()
   -    setSuperField(this, "logManager", logManager)
   -    addService(logManager)
   -
   sql/hive/v0.13.1/src/main/scala/org/apache/spark/sql/hive/Shim13.scala 
   -  import org.apache.hive.com.esotericsoftware.kryo.Kryo
   +  import com.esotericsoftware.kryo.Kryo
   
3. Update spark package:
   - Repackage spark: ./make-distribution.sh --tgz -Pyarn -Phive -Phive-thriftserver
   - copy hive-site.xml to ${SPARK_HOME}/conf
   - Update ${SPARK_HOME}/lib directory