Kafka(6)How to Monitor Kafka

最新推荐文章于 2025-04-09 23:04:02 发布

magic_dreamer

最新推荐文章于 2025-04-09 23:04:02 发布

阅读量123

点赞数

CC 4.0 BY-SA版权

分类专栏： Database Distributed 文章标签：大数据 git

本文链接：https://blog.youkuaiyun.com/magic_dreamer/article/details/84628047

Distributed 同时被 2 个专栏收录

160 篇文章

订阅专栏

Database

53 篇文章

订阅专栏

本文介绍了Kafka监控工具KafkaOffsetMonitor和kafka-web-console的使用方法，包括如何通过命令行构建、运行并理解其内部工作原理。此外，文章还提供了一个网页访问示例，演示了如何实时查看Kafka集群的偏移量信息。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Kafka(6)How to Monitor Kafka

1. KafkaOffsetMonitor

This project is good.
https://github.com/quantifind/KafkaOffsetMonitor

build and run it
>sbt clean update
>sbt assembly
>java -cp target/scala-2.10/KafkaOffsetMonitor-assembly-0.2.1-SNAPSHOT.jar com.quantifind.kafka.offsetapp.OffsetGetterWeb --zk ubuntu-slave1 --port 8080 --refresh 10.seconds --retain 2.days

Visit the web page
http://localhost:8080

The most import class is something like com.quantifind.kafka.OffsetGetter.
It keeps using import kafka.utils.ZkUtils to connect to the zookeeper to fetch the information.

2. kafka-web-console
This project is here
https://github.com/claudemamo/kafka-web-console.git

build and run it
>git clone https://github.com/claudemamo/kafka-web-console.git

>sbt clean update gen-idea
>sbt run

Visit the page http://localhost:9000

It is using the com.twitter.zk.ZkClient to fetch the information from zookeeper.

If I plan to writer something myself. I need to understand this tool.

https://cwiki.apache.org/confluence/display/KAFKA/Kafka+data+structures+in+Zookeeper

References:
https://github.com/quantifind/KafkaOffsetMonitor

https://github.com/claudemamo/kafka-web-console