property description required? default
druid.emitter.kafka.bootstrap.servers Comma-separated Kafka broker. ([hostname:port],[hostname:port]...) yes none
druid.emitter.kafka.metric.topic Kafka topic name for emitter's target to emit service metric. yes none
druid.emitter.kafka.alert.topic Kafka topic name for emitter's target to emit alert. yes none
druid.emitter.kafka.producer.config JSON formatted configuration which user want to set additional properties to Kafka producer. no none
druid.emitter.kafka.clusterName Optional value to specify name of your druid cluster. It can help make groups in your monitoring environment. no none
druid.emitter.kafka.bootstrap.servers=CentOSNode1:9092,CentOSNode2:9092,CentOSNode3:9092
druid.emitter.kafka.metric.topic=druid-metric
druid.emitter.kafka.alert.topic=druid-alert
druid.emitter.kafka.producer.config={"max.block.ms":10000}
下载第三方插件
java \
-cp "lib/*" \
-Ddruid.extensions.directory="extensions" \
-Ddruid.extensions.hadoopDependenciesDir="hadoop-dependencies" \
io.druid.cli.Main tools pull-deps \
--no-default-hadoop \
-c "io.druid.extensions.contrib:kafka-emitter:0.12.1"
io.druid.extensions.contrib:kafka-emitter:0.12.1
java \
-cp "lib/*" \
-Ddruid.extensions.directory="extensions" \
-Ddruid.extensions.hadoopDependenciesDir="hadoop-dependencies" \
io.druid.cli.Main tools pull-deps \
--no-default-hadoop \
-c "io.druid.extensions.contrib:graphite-emitter:0.12.1"
java \
-cp "lib/*" \
-Ddruid.extensions.directory="extensions" \
-Ddruid.extensions.hadoopDependenciesDir="hadoop-dependencies" \
io.druid.cli.Main tools pull-deps \
--no-default-hadoop \
-c "io.druid.extensions.contrib:druid-redis-cache:0.12.1"
java \
-cp "lib/*" \
-Ddruid.extensions.directory="extensions" \
-Ddruid.extensions.hadoopDependenciesDir="hadoop-dependencies" \
io.druid.cli.Main tools pull-deps \
--no-default-hadoop \
-c "io.druid.extensions.contrib:druid-rabbitmq:0.12.1"
java \
-cp "lib/*" \
-Ddruid.extensions.directory="extensions" \
-Ddruid.extensions.hadoopDependenciesDir="hadoop-dependencies" \
io.druid.cli.Main tools pull-deps \
--no-default-hadoop \
-c "io.druid.extensions.contrib:druid-rocketmq:0.12.1"
java \
-cp "lib/*" \
-Ddruid.extensions.directory="extensions" \
-Ddruid.extensions.hadoopDependenciesDir="hadoop-dependencies" \
io.druid.cli.Main tools pull-deps \
--no-default-hadoop \
-c "io.druid.extensions.contrib:ambari-metrics-emitter:0.12.1"
Druid Kafka配置与插件安装
本文详细介绍了Druid中Kafka配置项的使用,包括必填项如broker服务器地址、metric及alert主题名,以及可选配置如producer属性和集群名称。此外,还提供了下载并安装多个Druid第三方插件的命令示例,如Kafka、Graphite、Redis缓存、RabbitMQ等。
1027





