Flink：Caused by: java.lang.RuntimeException: Failed to start checkpoint ID counter: Operation catego

最新推荐文章于 2025-03-18 16:55:27 发布

乖乖猪001

最新推荐文章于 2025-03-18 16:55:27 发布

阅读量5.6k

点赞数

分类专栏： flink

本文链接：https://blog.youkuaiyun.com/xiaozhaoshigedasb/article/details/89083885

版权

该问题的根源在于Hadoop的高可用(HA)配置，而非Flink本身。日志表明在尝试连接到一个备用节点时遇到错误。解决方法包括手动将备用节点切换为活动节点，或者通过执行特定命令强制转换。然而，这种方法仅适用于临时解决方案，尤其是在测试环境中。要彻底解决此问题，需要正确配置HDFS的HA信息。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

这里和Flink其实没多大关系，原因在于hadoop的HA。

org.apache.flink.client.program.ProgramInvocationException: Could not retrieve the execution result. (JobID: 6b7239c374a1701bc07d0f6c2e17e60a)
        at org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:261)
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:487)
        at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:66)
        at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1510)
        at org.apache.flink.streaming.api.scala.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.scala:645)
        at cn.com.sse.flinkKafkaConsumer$.main(flinkKafkaConsumer.scala:44)
        at cn.com.sse.flinkKafkaConsumer.main(flinkKafkaConsumer.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:529)
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:421)
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:427)
        at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:813)
        at org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:287)
        at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:213)
        at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1050)
        at org.apache.flink.client.cli.CliFrontend.lambda$main$11(CliFrontend.java:1126)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
        at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
        at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1126)
Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
        at org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:380)
        at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:870)
        at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:852)
        at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
        at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977)
        at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$5(FutureUtils.java:203)
        at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFut

最低0.47元/天解锁文章