kafka之broker部署

1.下载解压配置KAFKA_HOME
2.修改配置文件，本机主机名：hadoopIMOOC

vim $KAFKA_HOME/config/server.properties

配置项：

broker.id=0 //整数唯一不重复
listeners=PLAINTEXT://:9092
host.name=hadoopIMOOC
log.dirs=/home/yjc/app/kafka_2.11-0.9.0.0/kafka-logs
zookeeper.connect=hadoopIMOOC:2181

3.启动Zookeeper及kafka

./zkServer.sh start
zkCli.sh
kafka-server-start.sh $KAFKA_HOME/config/server.properties

4.创建topic

kafka-topics.sh --create --zookeeper hadoopIMOOC:2181 --replication-factor 1 --partitions 1 --topic hello-topic
kafka-topics.sh --list --zookeeper hadoopIMOOC:2181

5.生产消息

kafka-console-producer.sh --broker-list hadoopIMOOC:9092 --topic hello-topic

6.消费消息

kafka-console-consumer.sh --zookeeper hadoopIMOOC:2181 --topic hello-topic --from-beginning

7.查看所有topic信息

kafka-topics.sh --describe --zookeeper hadoopIMOOC:2181
kafka-topics.sh --describe --zookeeper hadoopIMOOC:2181 --topic hello-topic

单节点多broker

1.配置文件
server1.properties:

broker.id=1
listeners=PLAINTEXT://:9093
log.dirs=/home/yjc/app/kafka_2.11-0.9.0.0/kafka-logs/kafka-logs-1

server2.properties:

broker.id=2
listeners=PLAINTEXT://:9094
log.dirs=/home/yjc/app/kafka_2.11-0.9.0.0/kafka-logs/kafka-logs-2

server3.properties:

broker.id=3
listeners=PLAINTEXT://:9095
log.dirs=/home/yjc/app/kafka_2.11-0.9.0.0/kafka-logs/kafka-logs-3

2.启动kafka

kafka-server-start.sh -daemon $KAFKA_HOME/config/server1.properties &
kafka-server-start.sh -daemon $KAFKA_HOME/config/server2.properties &
kafka-server-start.sh -daemon $KAFKA_HOME/config/server3.properties &

3.创建topic

kafka-topics.sh --create --zookeeper hadoopIMOOC:2181 --replication-factor 3 --partitions 1 --topic topic-2
kafka-topics.sh --list --zookeeper hadoopIMOOC:2181

4.生产及消费消息

kafka-console-producer.sh --broker-list hadoopIMOOC:9093,hadoopIMOOC:9094,hadoopIMOOC:9095 --topic topic-2
kafka-console-consumer.sh --zookeeper hadoopIMOOC:2181 --topic topic-2 --from-beginning