Flink任务部署-deply总结

Flink作业deploy

https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/overview/

https://nightlies.apache.org/flink/flink-docs-release-1.13/zh/docs/deployment/resource-providers/yarn/

https://nightlies.apache.org/flink/flink-docs-release-1.13/zh/docs/deployment/cli/

命令汇总

standalone模式

# 启动命令
flink run \
			-m doitedu01:8081 \   #	-m 指定jobmanager的位置 可省略
			-p 4 \                # -p 指定并行度
			-c wordcount.StreamWordCount \
			/root/jars/myflink.jar \
			--host bigdata111 --port 6666  #自定义参数
#查看当前运行的任务：
flink list
#查看所有的任务：
flink list --all
#任务取消：
flink cancel jobid

application模式

./bin/flink run-application -t yarn-application \
    -Djobmanager.memory.process.size=2048m \
    -Dtaskmanager.memory.process.size=4096m \
    -Dyarn.provided.lib.dirs="hdfs://myhdfs/remote-flink-dist-dir" \
    hdfs://myhdfs/jars/MyApplication.jar

# List running job on the cluster
./bin/flink list -t yarn-application -Dyarn.application.id=application_XXXX_YY
# Cancel running job
./bin/flink cancel -t yarn-application -Dyarn.application.id=application_XXXX_YY <jobId>

Session模式

# 通过flink命令启动flink集群**
bin/yarn-session.sh -n 2 -s 2 -jm 1024 -tm 1024 -nm