【记录】flink提交offset给kafka的三种模式

槐序i

于 2021-08-09 15:55:12 发布

阅读量1.4k

点赞数

CC 4.0 BY-SA版权

分类专栏： flink kafka

本文链接：https://blog.youkuaiyun.com/spark9527/article/details/119539981

本文详细介绍了Flink处理Kafka数据时，关于offset提交的三种不同方式：1) 不提交offset；2) 在完成checkpoint后提交offset；3) 定期自动提交offset。每种方式各有特点，适用于不同的场景需求。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

/*
 * Licensed to the Apache Software Foundation (ASF) under one or more
 * contributor license agreements.  See the NOTICE file distributed with
 * this work for additional information regarding copyright ownership.
 * The ASF licenses this file to You under the Apache License, Version 2.0
 * (the "License"); you may not use this file except in compliance with
 * the License.  You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */

package org.apache.flink.streaming.connectors.kafka.config;

import org.apache.flink.annotation.Internal;

/**
 * The offset commit mode represents the behaviour of how offsets are extern