spark中bin/start-all.sh执行后报错

最新推荐文章于 2023-03-23 19:59:04 发布

原创最新推荐文章于 2023-03-23 19:59:04 发布 · 2.4k 阅读

1 ·

CC 4.0 BY-SA版权

文章标签：

#spark

spark 专栏收录该内容

1 篇文章

订阅专栏

在执行`bin/start-all.sh`后，Spark遇到错误。首先，需确认在/etc/profile配置文件中是否正确设置了JDK环境。其次，检查Spark的conf/spark-env.sh配置文件，确保指定Zookeeper的路径无误，避免逗号或减号等语法错误。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

[root@master spark-2.0.2-bin-hadoop2.7]# sbin/start-all.sh 
starting org.apache.spark.deploy.master.Master, logging to /root/servers/spark-2.0.2-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.master.Master-1-master.out
failed to launch org.apache.spark.deploy.master.Master:
  ========================================
  Error: Could not find or load main class master:2181,slave1:2181,slave2:2181
full log in /root/servers/spark-2.0.2-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.master.Master-1-master.out
slave2: starting org.apache.spark.deploy.worker.Worker, logging to /root/servers/spark-2.0.2-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.worker.Worker-1-slave2.out
master: starting org.apache.spark.deploy.worker.Worker, logging to /root/servers/spark-2.0.2-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.worker.Worker-1-master.out
slave2: failed to launch org.apache.spark.deploy.worker.Worker:
slave2:   ========================================
slave2:   Error: Could not find or load main class master:2181,slave1:2181,slave2:2181
slave2: full log in /root/servers/spark-2.0.2-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.worker.Worker-1-slave2.out
master: failed to launch org.apache.spark.deploy.worker.Worker:
master:   ========================================
master:   Error: Could not find or load main class master:2181,slave1:2181,slave2:2181
master: full log in /root/servers/spark-2.0.2-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.worker.Worker-1-master.out

1、检查/etc/profile文件里的jdk有没有配置

2、检查spark目录下的conf/spark-env.sh文件里设置zookeeper的路径配置有没有问题。比如多了个逗号或者“-”