【Pulsar】学习笔记-安装部署

Zookeeper安装 略

Pulsar部署

在任一个 zooKeeper 节点，初始化集群元数据

cd /opt/bdp/data01/pulsar/bin

./pulsar initialize-cluster-metadata \ --cluster pulsar-cluster \ --zookeeper 10.91.1.90:2181,10.91.3.47:2181,10.91.3.24:2181 \ --configuration-store 10.91.1.90:2181,10.91.3.47:2181,10.91.3.24:2181 \ --web-service-url http://10.91.1.90:8080,10.91.3.47:8080,10.91.3.24:8080 \ --web-service-url-tls https://10.91.1.90:8443,10.91.3.47:8443,10.91.3.24:8443 \ --broker-service-url pulsar://10.91.1.90:6650,10.91.3.47:6650,10.91.3.24:6650 \ --broker-service-url-tls pulsar+ssl://10.91.1.90:6651,10.91.3.47:6651,10.91.3.24:6651

初始化完成，会在最后一行显示Cluster metadata for 'pulsar-cluster' setup correctly

查看zkCli.sh 包含以下信息表示初始化成功

 

配置bookkeeper集群

三台分别创建目录 pulsar HOME_DIR

mkdir ./data/bookkeeper/tmp/journal -p

mkdir ./data/bookkeeper/tmp/ledger -p

配置bookkeeper

vim conf/bookkeeper.conf

# advertisedAddress 修改为服务器对应的ip,在另外两台服务器也做对应的修改 advertisedAddress=10.91.1.90 # 修改以下两个文件目录地址 journalDirectories=data/bookkeeper/tmp/journa ledgerDirectories=data/bookkeeper/tmp/ledger # 修改zk地址和端口信息 zkServers=10.91.1.90:2181,10.91.3.47:2181,10.91.3.24:2181

BookKeeper集群元数据设置

BookKeeper群集中的任何 bookie中运行一次

./bookkeeper shell metaformat

以下结果为初始化成功

19:54:47.066 [main-EventThread] INFO org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase - ZooKeeper client is connected now. Ledger root already exists. Are you sure to format bookkeeper metadata? This may cause data loss. (Y or N) Y 19:54:50.419 [main] INFO org.apache.bookkeeper.discover.ZKRegistrationManager - Successfully formatted BookKeeper metadata 19:54:50.523 [main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x1004f060bfb0006 closed 19:54:50.523 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x1004f060bfb0006

三台分别启动bookeeper

./pulsar-daemon start bookie

测试bookie是否启动

./bookkeeper shell bookiesanity

出现图下是bookie启动成功

 

配置部署broker

vim conf/broker.conf

zookeeperServers=10.91.1.90:2181,10.91.3.47:2181,10.91.3.24:2181 configurationStoreServers=10.91.1.90:2181,10.91.3.47:2181,10.91.3.24:2181 advertisedAddress=10.91.3.24 clusterName=pulsar-cluster ##和初始化的集群名称一致

三台分别启动broker

./pulsar-daemon start broker

查看broker节点情况

./pulsar-admin brokers list pulsar-cluster

"10.91.1.90:8080"

"10.91.3.24:8080"

"10.91.3.47:8080"

至此均部署启动完成

测试

订阅test主题(-n:消费的消息数量,-s:订阅的名字,-t:订阅的类型)

pulsar-client consume persistent://public/default/test \

-n 100 -s "consumer-test" -t "Exclusive"

发消息到test主题(-n:发送消息的次数,-m:消息内容)

pulsar-client produce persistent://public/default/test \

-n 1 -m "Hello Pulsar"

结果

----- got message -----

Hello Pulsar