kafka producer java API的实现

最新推荐文章于 2025-05-28 09:40:56 发布

BornZhu

最新推荐文章于 2025-05-28 09:40:56 发布

阅读量1.2k

点赞数

CC 4.0 BY-SA版权

分类专栏： Kafka

本文链接：https://blog.youkuaiyun.com/BornZhu/article/details/78678253

Kafka 专栏收录该内容

6 篇文章

订阅专栏

1.开发环境的构建

使用IDEA+MAVEN构建开发环境，可以采用Maven中scala-archetype-simple模板。

2.pom.xml的配置

这里scala版本为2.11.8，kafka版本为0.9.0.0

<properties>
    <scala.version>2.11.8</scala.version>
    <kafka.version>0.9.0.0</kafka.version>
  </properties>

  <dependencies>
    <dependency>
      <groupId>org.scala-lang</groupId>
      <artifactId>scala-library</artifactId>
      <version>${scala.version}</version>
    </dependency>
    <dependency>
      <groupId>org.apache.kafka</groupId>
      <artifactId>kafka_2.11</artifactId>
      <version>${kafka.version}</version>
    </dependency>

  </dependencies>

3.Kafka配置类KafkaProperties

public static final String ZK = "192.168.254.128:2181";

public static final String TOPIC = "hello_topic";

public static final String BROKER_LIST = "192.168.254.128:9092";

4.生产者类

import kafka.javaapi.producer.Producer;
import kafka.producer.KeyedMessage;
import kafka.producer.ProducerConfig;

import java.util.Properties;

/**
 * Kafka生产者
 */
public class KafkaProducer extends Thread{
    private String topic;

    private Producer<Integer,String> producer;

    public KafkaProducer(String topic){
        this.topic = topic;

        Properties properties = new Properties();

        properties.put("metadata.broker.list",KafkaProperties.BROKER_LIST);
        properties.put("serializer.class","kafka.serializer.StringEncoder");
        properties.put("request.required.acks","1");

        producer = new Producer<Integer, String>(new ProducerConfig(properties));
    }

    @Override
    public void run() {
        int messageNo = 1;
        while (true){
            String message = "message_"+ messageNo;
            producer.send(new KeyedMessage<Integer, String>(topic,message));
            System.out.println("Send:" + message);

            messageNo++;

            try {
                Thread.sleep(2000);
            }catch (Exception e){
                e.printStackTrace();
            }
        }
    }
}

5.测试类

public class KafkaClientsApp {
    public static void main(String[] args) {
        new KafkaProducer(KafkaProperties.TOPIC).start();
    }
}

6.测试结果

测试之前要开启zookeeper，kafka，和kafka consumer

本地生产的数据被服务器上的消费者消费