使用Ansible安装storm及HA的配置方法

本文介绍了如何利用Ansible在CentOS系统上安装并配置Storm集群,包括创建目录、上传Storm包和配置文件、设置nimbus主机、配置高可用(HA)以及编写启动和停止脚本。此外,还提到了Storm的UI管理和HA配置的关键参数。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

Ansible安装storm

#有小伙伴问我怎么直接就从这开始,环境呢,我想说,兄弟,安装ansible、和初始化环境啥的就不用我给你写了吧,用户直接用的root,为了方便(不过生产不能这么搞嗷),免密互信,关防火墙和selinux等自己随便搞搞就好了

注意:启动之前别忘了启动zk

mkdir -p /root/ansible/roles/storm/files

cd /root/ansible/roles/storm/files

#将下载好的Storm包和配置文件上传至此/etc/ansible/roles/storm/files

#配置文件

storm.zookeeper.servers:

- "server01"

- "server02"

- "server03"

storm.zookeeper.port: 2181

nimbus.seeds: ["server01","server02"]

supervisor.slots.ports:

- 6700

- 6701

ui.port: 10080

vim hosts

[storm_servers]

server01

server02

server03

vim storm.yml

- hosts: storm_servers

roles:

- storm

mkdir tasks

vim main.yml

---

- name: copy file and unzip

unarchive: src=storm.tar.gz dest=/root

- name: install config storm

copy: src=storm.yaml dest=/root/apache-storm-1.2.2/conf/storm.yaml

cd ..

mkdir vars

vim main.yml

nimbus_hostname: server01

ansible-playbook -i hosts storm.yml

#浏览器访问localhost:10080,查看管理页面

#所谓的高可用HA配置就是多了一个或几个Nimbus而已,,用几个看自己心情,supervisor本来就是分布式的所以无所谓

#就在配置文件中 如下配置:

storm.zookeeper.servers:

- "server01"

- "server02"

- "server03"

storm.zookeeper.port: 2181

nimbus.seeds: ["server01","server02"]

supervisor.slots.ports:

- 6700

- 6701

ui.port: 10080

---------------------------------------------------------------------------------------------------------------

#安装完成后编辑启停脚本!

vim storm-start.sh

#!/bin/bash

echo "Storm Nimbus is Running"

nohup /root/apache-storm-1.2.2/bin/storm nimbus 1>/dev/null 2>&1 &

sleep 15

echo "Storm Nimbus is Successfully"

for host in server01 server02 server03

do

echo "$host Storm Supervisor is Running"

ssh $host "source /etc/profile;nohup sh /root/apache-storm-1.2.2/bin/storm supervisor 1>/dev/null 2>&1 & "

sleep 10

echo "$host Storm Supervisor is Successfully"

echo "$host Storm Logviewer is Running"

ssh $host "source /etc/profile;nohup sh /root/apache-storm-1.2.2/bin/storm logviewer 1>/dev/null 2>&1 & "

sleep 10

echo "$host Storm Logviewer is Successfully"

done

echo "Storm UI is Running"

nohup /root/apache-storm-1.2.2/bin/storm ui 1>/dev/null 2>&1 &

sleep 15

echo "Storm UI is Successfully"

vim storm-stop.sh

jps | grep nimbus | cut -c 1-5 | xargs kill -s 9

echo "server01 Storm Nimbus is Stopping"

jps | grep core | cut -c 1-5 | xargs kill -s 9

echo "server01 Storm UI is Stopping"

for host in server01 server02 server03

do

ssh $host "source /etc/profile;jps | grep Supervisor | cut -c 1-5 | xargs kill -s 9"

echo "$host Storm Supervisor is Stopping"

ssh $host "source /etc/profile;jps | grep logviewer | cut -c 1-5 | xargs kill -s 9"

echo "$host Storm Logviewer is Stopping"

done

亲测无坑! 下期更新hadoop

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值