cdh5.x版本将spark1.6升级为spark2之后，hue执行spark2报错问题

大数据小蜗牛

于 2019-01-10 16:36:57 发布

阅读量706

点赞数

分类专栏： CDH Spark 文章标签： cdh spark2 hue

本文链接：https://blog.youkuaiyun.com/qq_40651753/article/details/86239630

版权

Spark 同时被 2 个专栏收录

6 篇文章

订阅专栏

CDH

3 篇文章

订阅专栏

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, Library directory '/*/hue/appcache/application_1547098367136_0236/container_e32_1547098367136_0236_01_000002/./assembly/target/scala-2.11/jars' does not exist; make sure Spark is built.
java.lang.IllegalStateException: Library directory '/*/hue/appcache/application_1547098367136_0236/container_e32_1547098367136_0236_01_000002/./assembly/target/scala-2.11/jars' does not exist; make sure Spark is built.

错误如代码所示

解决方法：在hue提交命令时指定 --conf spark.yarn.jars=*.jars即可，如图所示