flink配置

最新推荐文章于 2025-03-23 00:33:29 发布

原创最新推荐文章于 2025-03-23 00:33:29 发布 · 416 阅读

1 ·

CC 4.0 BY-SA版权

Flink学习笔记专栏收录该内容

17 篇文章

订阅专栏

本文介绍Apache Flink集群的基本操作命令，如启动、停止、列出任务等，并展示了关键配置参数，适用于Flink集群管理和故障排查。

./bin/flink list 列出计划和正在运行的job
./bin/flink list -s 列出预定job
./bin/flink list -r 列出正在运行的job
./bin/flink list -m yarn-cluster -yid -r 列出在YARN 中运行的job
./bin/flink cancel 通过jobID取消job
./bin/flink stop 通过jobID停止job

env.log.dir: /var/log/flink
high-availability.cluster-id: cluster_yarn
high-availability.storageDir: hdfs:///user/flink/ha
high-availability.zookeeper.path.root: /flink
jobmanager.heap.size: 1024m
rest.port: 8081
security.kerberos.login.keytab:
security.kerberos.login.principal:
security.kerberos.login.use-ticket-cache: false
state.checkpoints.dir: hdfs:///user/flink/cluster_yarn/checkpoints
state.savepoints.dir: hdfs:///user/flink/cluster_yarn/savepoints
streaming.mode: true
taskmanager.heap.size: 1024m
taskmanager.numberOfTaskSlots: 1
yarn.application-attempts: 10
yarn.taskmanagers: 1
high-availability: zookeeper
high-availability.zookeeper.quorum: hadoop102:2181,hadoop103:2181,hadoop104:2181

./flink run -m yarn-cluster -d /home/atguigu/flink-12-test-1.0-SNAPSHOT-shaded.jar -c test.Mytest -yjm 1024m -ytm 1024m
/etc/hadoop/conf.cloudera.yarn/yarn-site.xml