Logstash 配置多个kafka出现InstanceAlreadyExistsException问题

csdn277

于 2020-01-02 14:16:41 发布

阅读量3k

点赞数

分类专栏：学习记录文章标签： logstash kafka InstanceAlreadyExistsException

本文链接：https://blog.youkuaiyun.com/csdn277/article/details/103803273

版权

[kafka_spout:7-MultipleThreadSpoutExecutors] WARN o.a.kafka.common.utils.AppInfoParser - Error registering AppInfo mbean

javax.management.InstanceAlreadyExistsException: kafka.consumer:type=app-info

阅读源码不难发现

问题出在配置每个kafka时需要指定唯一的client_id，有一篇里面讲到了，这里就不重复写了，http://www.mamicode.com/info-detail-1889211.html

贴个简单配置：

input {

    kafka {
        type => "system"
        bootstrap_servers => "Kafka-01:19092,Kafka-02:19092,Kafka-03:19092"
        group_id => "log_admin"
        client_id => "log_system"
        topics => ["system_log"]
        auto_offset_reset = "earliest"
        consumer_threads => 3
        decorate_events => true
        codec => 'json'
    }

    kafka {