kafka配置

最新推荐文章于 2025-07-02 11:43:06 发布

原创最新推荐文章于 2025-07-02 11:43:06 发布 · 1.1k 阅读

1 ·

CC 4.0 BY-SA版权

中间件专栏收录该内容

11 篇文章

订阅专栏

记一下kafka生产者，消费者的Properties配置信息

producer

Properties properties = new Properties();
properties.setProperty(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, bootstrapServerConfig);
properties.setProperty(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, "org.apache.kafka.common.serialization.StringSerializer");
properties.setProperty(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG, "org.apache.kafka.common.serialization.StringSerializer");
properties.setProperty(ProducerConfig.ACKS_CONFIG, "1");
properties.setProperty(ProducerConfig.BATCH_SIZE_CONFIG, "204800");
properties.setProperty(ProducerConfig.RETRIES_CONFIG, "1");
properties.setProperty(ProducerConfig.PARTITIONER_CLASS_CONFIG, "org.apache.kafka.clients.producer.internals.DefaultPartitioner");
properties.setProperty(ProducerConfig.BUFFER_MEMORY_CONFIG, "33554432");
properties.setProperty(ProducerConfig.COMPRESSION_TYPE_CONFIG, "none");
properties.setProperty(ProducerConfig.MAX_BLOCK_MS_CONFIG, "60000");
properties.setProperty(ProducerConfig.SEND_BUFFER_CONFIG, "131072");
properties.setProperty(ProducerConfig.CONNECTIONS_MAX_IDLE_MS_CONFIG, "540000");
properties.setProperty(ProducerConfig.MAX_REQUEST_SIZE_CONFIG, "1048576");
properties.setProperty(ProducerConfig.REQUEST_TIMEOUT_MS_CONFIG, "30000");
properties.setProperty(ProducerConfig.RECEIVE_BUFFER_CONFIG, "32768");

consumer

Properties properties = new Properties();
properties.setProperty(ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG, bootstrapServerConfig);
properties.setProperty(ConsumerConfig.GROUP_ID_CONFIG, consumerGroupId);
properties.setProperty(ConsumerConfig.ENABLE_AUTO_COMMIT_CONFIG, "false");
properties.setProperty(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, "org.apache.kafka.common.serialization.StringDeserializer");
properties.setProperty(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, "org.apache.kafka.common.serialization.StringDeserializer");
properties.setProperty(ConsumerConfig.AUTO_OFFSET_RESET_CONFIG, "earliest");
properties.setProperty(ConsumerConfig.MAX_PARTITION_FETCH_BYTES_CONFIG, "1048576");
properties.setProperty(ConsumerConfig.REQUEST_TIMEOUT_MS_CONFIG, "60000");
properties.setProperty(ConsumerConfig.SESSION_TIMEOUT_MS_CONFIG, "30000");
properties.setProperty(ConsumerConfig.HEARTBEAT_INTERVAL_MS_CONFIG, "10000");

其中ConsumerConfig.SESSION_TIMEOUT_MS_CONFIG有个限制，必须是在roup.min.session.timeout.ms和roup.max.session.timeout.ms之间，max默认是30000，这个值不设置还不行