Flink RPC通信超时 In that case, you can try to increase pekko.ask.timeout. AskTimeoutException

问题:In that case, you can try to increase pekko.ask.timeout.

可能会导致,source端和sink端中间,在创建不存在的表时,事务丢失,目标表未在首次创建会导致sink端一直无法 stream load data 成功到该目标表中,持续报错

Caused by: java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException: Invocation of [RemoteRpcInvocation(JobMasterOperatorEventGateway.sendRequestToCoordinator(OperatorID, SerializedValue))] at recipient [pekko.tcp://flink@172.29.105.98:6123/user/rpc/jobmanager_4] timed out. This is usually caused by: 1) Pekko failed sending the message silently, due to problems like oversized payload or serialization failures. In that case, you should find detailed error information in the logs. 2) The recipient needs more time for responding, due to problems like slow machines or network jitters. In that case, you can try to increase pekko.ask.timeout.
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
	at org.apache.flink.cdc.runtime.operators.schema.SchemaOperator.sendRequestToCoordinator(SchemaOperator.java:318)
	... 26 more

解决:增加RPC超时时间

根据错误提示,可以尝试增加Flink的RPC超时时间。在flink-conf.yaml配置文件中增加或修改以下配置项:

pekko.ask.timeout: 5min

注意这里的配置名可能随着Flink版本的不同有所变动,具体配置项请查阅Flink 1.18版本的官方文档。

另外,checkpoint 时间也可以放开3min配置项,避免网络RPC超时

execution.checkpointing.interval: 3min

参考:Flink CDC里这种报错怎么解决?_问答-阿里云开发者社区

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

SunTecTec

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值