zookeeper、kafka的安装与测试（Cent OS 7）

zookeeper

1 将下载好的安装包放在/usr/local目录下，解压

2 在conf目录下复制一份配置文件修改内容

[root@Kafka ~]# cd /usr/local/zookeeper-3.4.11/
[root@Kafka zookeeper-3.4.11]# cd conf/
[root@Kafka conf]# cp zoo_sample.cfg zoo_gxl.cfg
[root@Kafka conf]# vi zoo_gxl.cfg
修改一下内容：
dataDir=/usr/local/zookeeper-3.4.11/dataDir_gxl

3 启动zookeeper

[root@Kafka zookeeper-3.4.11]# ./bin/zkServer.sh start conf/zoo_gxl.cfg
ZooKeeper JMX enabled by default
Using config: conf/zoo_gxl.cfg
Starting zookeeper … STARTED

4 如上信息启动成功，启动客户端测试

[root@Kafka zookeeper-3.4.11]# ./bin/zkCli.sh -server 192.168.142.158:2181

5 依次是查看根节点、创建节点、查看节点、节点状态、退出

[zk: 192.168.142.158:2181(CONNECTED) 8] ls /
[zookeeper]
[zk: 192.168.142.158:2181(CONNECTED) 9] create /test ‘this test znode’
Created /test
[zk: 192.168.142.158:2181(CONNECTED) 10] ls /test
[]
[zk: 192.168.142.158:2181(CONNECTED) 11] stat /test
cZxid = 0x4
ctime = Tue Mar 13 15:29:57 CST 2018
mZxid = 0x4
mtime = Tue Mar 13 15:29:57 CST 2018
pZxid = 0x4
cversion = 0
dataVersion = 0
[zk: 192.168.142.158:2181(CONNECTED) 12] quit

kafka

1 将下载好的安装包放在/usr/local目录下，解压

2 打开config目录复制3份配置文件，修改其中内容

[root@Kafka kafka_2.12-1.0.1]# cd config
[root@Kafka config]# cp server.properties servergxl-1.properties
[root@Kafka config]# cp server.properties servergxl-2.properties
[root@Kafka config]# cp server.properties servergxl-3.properties
[root@Kafka config]# vi servergxl-1.properties
[root@Kafka config]# vi servergxl-2.properties
[root@Kafka config]# vi servergxl-3.properties
分别修改一下内容：
/############################# Server Basics #############################
broker.id=1 【根据配置文件的编号分别填入1|2|3】
delete.topic.enable=true
/############################# Socket Server Settings #####################
listeners=PLAINTEXT://192.168.193.128:9092 【同理为9092|9093|9094】
/############################# Log Basics #############################
log.dirs=/usr/kafka_2.11-0.11.0.0/kafka-logs-1
/############################# Zookeeper ##############################
zookeeper.connect=192.168.193.128:2181

3 分别启动

[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-server.sh config/servergxl-1.partitions
[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-server.sh config/servergxl-2.partitions
[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-server.sh config/servergxl-3.partitions

4 创建主题topic名称为mytopic

[root@Kafka ~]# cd /usr/local/kafka_2.12-1.0.1/
[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-topics.sh –zookeeper localhost –create –topic mytopic –partitions 3 –replication-factor 3
Created topic “mytopic”.

5 查看topic列表、查看mytopic状态

[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-topics.sh –zookeeper localhost –list
mytopic
[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-topics.sh –zookeeper localhost –describe –topic mytopic
Topic:mytopic PartitionCount:3 ReplicationFactor:3 Configs:
Topic: mytopic Partition: 0 Leader: 1 Replicas: 1,3,2 Isr: 1,3,2
Topic: mytopic Partition: 1 Leader: 2 Replicas: 2,1,3 Isr: 2,1,3
Topic: mytopic Partition: 2 Leader: 3 Replicas: 3,2,1 Isr: 3,2,1

6 新建终端模拟订阅

[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-console-consumer.sh –zookeeper localhost:2181 –topic mytopic –from-beginning
或者：
[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-console-consumer.sh –bootstrap-server 192.168.142.158:9092,192.168.142.158:9093,192.168.142.158:9094 –topic mytopic –from-beginning

7 新建终端模拟发布

[root@Kafka kafka_2.12-1.0.1]# ./bin/kafka-console-producer.sh –broker-list 192.168.142.158:9092,192.168.143.158:9093,192.168.143.158:9094 –topic mytopic

8 输入hello查看订阅端是否接受到信息，有则测试成功

hello

集群参考

http://blog.youkuaiyun.com/zxy987872674/article/details/72466504
http://czj4451.iteye.com/blog/2041096

Cent OS 7命令变化

http://blog.youkuaiyun.com/wzyzzu/article/details/52700296