flink 7-提交任务

提交方式

一般都是提交到yarn上,当然单机也是可以跑的,而且单机不用安装flink和hadoop

第一种提交到yarn的方法

提交到yarn-cluster

flink -m yarn-cluster -c className -j *.jar -d > log.log 2>&1 &
第二种提交到yarn的方法

先启一个yarn-session,在yarn上开辟一块资源,这时会生成一个yid,然后向这个资源池里提交任务

yarn-session.sh -n 9 -tm 1024 -s 4 -nm Name -d

然后向这个yid中提交job

flink run -c className -j *.jar -yid application_id -d > log.log 2>&1 &
两种提交yarn的区别

个人理解第一种方法各种配置比较个性化,第二种可以在yarn上开辟资源,往session中提交多个job

[hadoop@hadoop01 flink]$ cd log [hadoop@hadoop01 log]$ ls flink-hadoop-scala-shell-local-hadoop01.log flink-hadoop-standalonesession-0-hadoop01.log flink-hadoop-standalonesession-0-hadoop01.out flink-hadoop-standalonesession-10-hadoop01.log flink-hadoop-standalonesession-10-hadoop01.out flink-hadoop-standalonesession-11-hadoop01.log flink-hadoop-standalonesession-11-hadoop01.log.1 flink-hadoop-standalonesession-11-hadoop01.log.2 flink-hadoop-standalonesession-11-hadoop01.out flink-hadoop-standalonesession-11-hadoop01.out.1 flink-hadoop-standalonesession-11-hadoop01.out.2 flink-hadoop-standalonesession-12-hadoop01.log flink-hadoop-standalonesession-12-hadoop01.out flink-hadoop-standalonesession-7-hadoop01.log flink-hadoop-standalonesession-7-hadoop01.out flink-hadoop-standalonesession-8-hadoop01.log flink-hadoop-standalonesession-8-hadoop01.out flink-hadoop-standalonesession-9-hadoop01.log flink-hadoop-standalonesession-9-hadoop01.out flink-hadoop-taskexecutor-0-hadoop01.log flink-hadoop-taskexecutor-0-hadoop01.out flink-hadoop-taskexecutor-10-hadoop01.log flink-hadoop-taskexecutor-10-hadoop01.log.1 flink-hadoop-taskexecutor-10-hadoop01.log.2 flink-hadoop-taskexecutor-10-hadoop01.out flink-hadoop-taskexecutor-10-hadoop01.out.1 flink-hadoop-taskexecutor-10-hadoop01.out.2 flink-hadoop-taskexecutor-11-hadoop01.log flink-hadoop-taskexecutor-11-hadoop01.out flink-hadoop-taskexecutor-6-hadoop01.log flink-hadoop-taskexecutor-6-hadoop01.out flink-hadoop-taskexecutor-7-hadoop01.log flink-hadoop-taskexecutor-7-hadoop01.out flink-hadoop-taskexecutor-8-hadoop01.log flink-hadoop-taskexecutor-8-hadoop01.out flink-hadoop-taskexecutor-9-hadoop01.log flink-hadoop-taskexecutor-9-hadoop01.out [hadoop@hadoop01 log]$
最新发布
12-27
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值