【记录】flink提交offset给kafka的三种模式

最新推荐文章于 2025-08-31 17:35:10 发布

原创

最新推荐文章于 2025-08-31 17:35:10 发布 · 1.5k 阅读

0 ·

CC 4.0 BY-SA版权

本文详细介绍了Flink处理Kafka数据时，关于offset提交的三种不同方式：1) 不提交offset；2) 在完成checkpoint后提交offset；3) 定期自动提交offset。每种方式各有特点，适用于不同的场景需求。

/*
 * Licensed to the Apache Software Foundation (ASF) under one or more
 * contributor license agreements.  See the NOTICE file distributed with
 * this work for additional information regarding copyright ownership.
 * The ASF licenses this file to You under the Apache License, Version 2.0
 * (the "License"); you may not use this file except in compliance with
 * the License.  You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */

package org.apache.flink.streaming.connectors.kafka.config;

import org.apache.flink.annotation.Internal;

/**
 * The offset commit mode represents the behaviour of how offsets are extern