
spark
大数据技术扩展
利剑 -~
追求卓越成功就会出其不意找上门
展开
-
spark on yarn webUI logs不能查看
执行spark on yarn 执行:./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-cluster --executor-memory 1G --num-executors 3 ./lib/spark-examples-1.6.3-hadoop2.6.0.jar 10 命令执行成功后在yar...原创 2018-07-08 23:42:41 · 3991 阅读 · 0 评论 -
spark on yarn 部署问题
spark on yarn 部署报:java.io.IOException: Resource file:/usr/local/spark-1.6.3-bin-hadoop2.6/lib/spark-assembly-1.6.3-hadoop2.6.0.jar changed on src filesystem (expected 1530607524000, was 1478125561000解...原创 2018-07-08 21:28:14 · 1565 阅读 · 0 评论