flink启动流程源码分析_flink webui启动源码-优快云博客

本文链接：https://blog.youkuaiyun.com/wjandy0211/article/details/102912547

本文详细解析了Apache Flink集群的启动流程，包括jobmanager和taskmanager的启动过程，以及涉及的配置文件和关键脚本。阐述了如何通过jobmanager.sh和taskmanager.sh脚本调用flink-daemon.sh来启动不同组件。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

flink启动 https://www.cnblogs.com/love-yh/category/1490983.html

flink启动脚本是：start-cluster.sh

bin=`dirname "$0"`
bin=`cd "$bin"; pwd`

. "$bin"/config.sh

# Start the JobManager instance(s)
shopt -s nocasematch
if [[ $HIGH_AVAILABILITY == "zookeeper" ]]; then
    # HA Mode
    readMasters

    echo "Starting HA cluster with ${#MASTERS[@]} masters."

    for ((i=0;i<${#MASTERS[@]};++i)); do
        master=${MASTERS[i]}
        webuiport=${WEBUIPORTS[i]}

        if [ ${MASTERS_ALL_LOCALHOST} = true ] ; then
            "${FLINK_BIN_DIR}"/jobmanager.sh start "${master}" "${webuiport}"
        else
            ssh -n $FLINK_SSH_OPTS $master -- "nohup /bin/bash -l \"${FLINK_BIN_DIR}/jobmanager.sh\" start ${master} ${webuiport} &"
        fi
    done

else
    echo "Starting cluster."

    # Start single JobManager on this machine
    "$FLINK_BIN_DIR"/jobmanager.sh start
fi
shopt -u nocasematch

# Start TaskManager instance(s)
TMSlaves start

可以看出启动分为两阶段：第一阶段启动jobmanager，第二阶段启动taskmanager，对应的配置在conf下。

jobmanager启动：

jobmanager启动调用的脚本是：jobmanager.sh start ，然后再调用:flink-daemon.sh start standalonesession

case $DAEMON in
    (taskexecutor)
        CLASS_TO_RUN=org.apache.flink.runtime.taskexecutor.TaskManagerRunner
    ;;

    (zookeeper)
        CLASS_TO_RUN=org.apache.flink.runtime.zookeeper.FlinkZooKeeperQuorumPeer
    ;;

    (historyserver)
        CLASS_TO_RUN=org.apache.flink.runtime.webmonitor.history.HistoryServer
    ;;

    (standalonesession)
        CLASS_TO_RUN=org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint
    ;;

    (standalonejob)
        CLASS_TO_RUN=org.apache.flink.container.entrypoint.StandaloneJobClusterEntryPoint
    ;;

    (*)
        echo "Unknown daemon '${DAEMON}'. $USAGE."
        exit 1
    ;;
esac

可以看出调用的是org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint

出入的参数如下：

args=("--configDir" "${FLINK_CONF_DIR}" "--executionMode" "cluster")
    if [ ! -z $HOST ]; then
        args+=("--host")
        args+=("${HOST}")
    fi

    if [ ! -z $WEBUIPORT ]; then
        args+=("--webui-port")
        args+=("${WEBUIPORT}")
    fi

ide中配置启动，查看启动流程：

taskmanager启动：

taskmanager启动调用的是taskmanager.sh，然后调用是flink-daemon.sh start taskexecutor,

同上可以看出调用的是：

org.apache.flink.runtime.taskexecutor.TaskManagerRunner