Spark运行脚本 start-all.sh（standalone）_spark start-all.sh-优快云博客

本文详细介绍了一种一键启动Spark集群的方法，包括环境变量检查、加载配置、启动Master节点及所有Worker节点的过程。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

#!/usr/bin/env bash

#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#    http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#

# Start all spark daemons.
# Starts the master on this node.
# Starts a worker on each node specified in conf/slaves

if [ -z "${SPARK_HOME}" ]; then
  export SPARK_HOME="$(cd "`dirname "$0"`"/..; pwd)"
fi

# Load the Spark configuration
. "${SPARK_HOME}/sbin/spark-config.sh"   

# Start Master
"${SPARK_HOME}/sbin"/start-master.sh   

# Start Workers
"${SPARK_HOME}/sbin"/start-slaves.sh

1）先检查Spark的环境变量；

2）加载Spark的相关配置项：默认和自定义；

3）执行start-master.sh，启动Master节点；

4）执行start-slaves.sh，启动所有的Worker节点。