大数据异常

# 问题
# flink消费kafka数据,checkpoint异常
[INFO ] 2023-01-17 14:06:13,681(14105) --> [Checkpoint Timer] org.apache.flink.runtime.checkpoint.CheckpointCoordinator.onTriggerFailure(CheckpointCoordinator.java:888): Failed to trigger checkpoint for job d79be1d50b635677ee5b7d8f311f6908 since some tasks of job d79be1d50b635677ee5b7d8f311f6908 has been finished, abort the checkpoint Failure reason: Not all required tasks are currently running.

#原因
# flink 并行度大于topic分区,导致有空余并行task处于不运行状态  

#问题
Caused by: org.apache.flink.util.FlinkRuntimeException: unable to recover, error -3: resource manager error has occurred. [XAER_RMERR: Fatal error occurred in the transaction branch - check your data for consistency]
    at org.apache.flink.connector.jdbc.xa.XaFacadeImpl.wrapException(XaFacadeImpl.java:369)
    at org.apache.flink.connector.jdbc.xa.XaFacadeImpl.lambda$execute$12(XaFacadeImpl.java:280)
#原因
#flink-jdbc-eos需要支持分布式事务XA, 详情见:https://zhuanlan.zhihu.com/p/400930855
#授予root,XA_RECOVER_ADMIN权限即可
GRANT XA_RECOVER_ADMIN ON *.* TO 'root'@'%';
FLUSH PRIVILEGES;
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值