java客户端访问kafka

最新推荐文章于 2023-09-24 17:43:30 发布

原创最新推荐文章于 2023-09-24 17:43:30 发布 · 261 阅读

0 ·

CC 4.0 BY-SA版权

java 专栏收录该内容

76 篇文章

订阅专栏

本文介绍在CentOS7环境下配置Kafka消费者的过程，详细展示了如何通过Java代码创建KafkaConsumer实例，订阅主题并持续监听消息。文章覆盖了从关闭防火墙到设置消费者属性，再到实现消息监听的完整步骤。

kafka版本：kafka_2.11-0.11.0.1.tgz

centos7

关闭防火墙：systemctl stop firewalld.service

在kafka中配置文件：

listeners=PLAINTEXT://192.168.80.132:9092

在java创建consumer：

package com.vincent;

import org.apache.kafka.clients.consumer.ConsumerRecord;
import org.apache.kafka.clients.consumer.ConsumerRecords;
import org.apache.kafka.clients.consumer.KafkaConsumer;

import java.util.Arrays;
import java.util.Properties;

/**
 * Created with IntelliJ IDEA.
 * User: vincent
 * Date: 2017/10/26
 * Time: 14:39
 */
public class Test {
    public static void main(String[] args) {
        Properties props = new Properties();
        props.put("bootstrap.servers", "192.168.80.132:9092");
        props.put("group.id", "test");
        props.put("enable.auto.commit", "true");
        props.put("auto.commit.interval.ms", "1000");
        props.put("session.timeout.ms", "30000");
        props.put("key.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
        props.put("value.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
        KafkaConsumer<String, String> consumer = new KafkaConsumer<>(props);
        consumer.subscribe(Arrays.asList("test"));
        while (true) {
            ConsumerRecords<String, String> records = consumer.poll(100);
            for (ConsumerRecord<String, String> record : records)
                System.out.printf("offset = %d, key = %s, value = %s", record.offset(), record.key(), record.value());
        }
    }
}