记事本

最新推荐文章于 2024-02-14 09:54:45 发布

原创最新推荐文章于 2024-02-14 09:54:45 发布 · 455 阅读

0 ·

CC 4.0 BY-SA版权

消息专栏收录该内容

1 篇文章

订阅专栏

消息中心

需求

前端获取方式：主动，被动

订阅发布

异步

技术选型

kafka

docker部署

[root@shen kafka-test]# cat docker-compose.yml 
version: '2'
services:
  zookeeper:
    image: docker.io/zookeeper
    ports:
      - "2181:2181"
  kafka:
    image: wurstmeister/kafka
    ports:
      - "9092:9092"
    environment:
      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://:9092
      KAFKA_LISTENERS: PLAINTEXT://:9092
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock

cmd测试：

创建

docker exec kafka-test_kafka_1 kafka-topics.sh --create --topic topic001 --partitions 1 --zookeeper zookeeper:2181 --replication-factor 1

生产

docker exec -it kafka-test_kafka_1 kafka-console-producer.sh --topic topic001 --broker-list kafka-test_kafka_1:9092

消费

告警：

[2020-03-11 11:00:19,684] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:19,785] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:19,886] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:19,987] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:20,088] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:20,188] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:20,289] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:20,390] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:20,491] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:20,592] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)
[2020-03-11 11:00:20,693] WARN [Consumer clientId=consumer-console-consumer-3966-1, groupId=console-consumer-3966] 1 partitions have leader brokers without a matching listener, including [topic001-0] (org.apache.kafka.clients.NetworkClient)