storm UI界面各参数全解

storm UI界面各参数全解

原创  2014年09月22日 11:10:39

• 6588

Storm UI（Storm UI首页)

Cluster Summary（集群概况）

Version（版本）	Nimbus uptime（nimbus运行时长）	Supervisors（supervisor节点数）	Used slots（集群上已被使用的slots数目）	Free slots（集群上空闲的slots数目）	Total slots（集群上的slots数目）	Executors（集群上各个top的workers总数）	Tasks（集群上各个top的tasks总数）
0.9.2-incubating	44m 48s	2	8	0	8	84	84

Topology summary（Topology概况）

Name（top名）	Id（top id）	Status(top状态：ACTIVE激活状态、Kill死亡状态、 Deactivate失效状态、Rebalance调整状态)	Uptime（top运行时长）	Num workers（Num tasks）	Num executors（每个Topology运行时的worker的数目，默认值是1，若在代码中设置，则此选项值被覆盖）	Num tasks（top的并发度，是由TopologyBuilder.setSpout()和TopologyBuilder.setBolt()第三个参数parallelism_hint之和加workers组成）
log2master	log2master-1-1411120914	ACTIVE	2d 17h 8m 18s	28	3	28
havedata	havedata-4-1411029946	ACTIVE	3d 18h 24m 28s	28	3	28
nodata	nodata-3-1411029925	ACTIVE	3d 18h 24m 49s	28	2	28
havedatahavelog2master	havedatahavelog2master-1-1411116976	ACTIVE	2d 18h 13m 57s	0	0	0

Supervisor summary（Supervisor概况）

Id（supervisor id）	Host(supervisor所在主机名称)	Uptime（supervisor节点运行时长）	Slots（supervisor上的slots数目，默认是4个，其端口分别是6700-6703）	Used slots（supervisor上已被使用的slots数目）
5e959828-9098-4a23-bccc-ed5e5860b891	slave1	42m 59s	4	4
ced12451-73fd-4dd9-95ea-4e646848e9c7	slave2	41m 27s	4	4

Nimbus Configuration（Nimbus配置信息）

Key	Value
dev.zookeeper.path	/tmp/dev-storm-zookeeper
topology.tick.tuple.freq.secs
topology.builtin.metrics.bucket.size.secs	60
topology.fall.back.on.java.serialization	true
topology.max.error.report.per.interval	5
zmq.linger.millis	5000
topology.skip.missing.kryo.registrations	false
storm.messaging.netty.client_worker_threads	1
ui.childopts	-Xmx768m
storm.zookeeper.session.timeout	20000
nimbus.reassign	true
topology.trident.batch.emit.interval.millis	500
storm.messaging.netty.flush.check.interval.ms	10
nimbus.monitor.freq.secs	10
logviewer.childopts	-Xmx128m
java.library.path	/usr/local/lib:/opt/local/lib:/usr/lib
topology.executor.send.buffer.size	1024
storm.local.dir（storm的工作目录）	/home/hadoop/storm/work
storm.messaging.netty.buffer_size	5242880
supervisor.worker.start.timeout.secs	120
topology.enable.message.timeouts	true
nimbus.cleanup.inbox.freq.secs	600
nimbus.inbox.jar.expiration.secs	3600
drpc.worker.threads	64
topology.worker.shared.thread.pool.size	4
nimbus.host（nimbus地址）	192.168.195.199
storm.messaging.netty.min_wait_ms	100
storm.zookeeper.port	2181
transactional.zookeeper.port
topology.executor.receive.buffer.size	1024
transactional.zookeeper.servers
storm.zookeeper.root(Storm在zookeeper集群中的根目录，默认是“/”,可以使用zkCli.sh查看)	/storm
storm.zookeeper.retry.intervalceiling.millis	30000
supervisor.enable	true
storm.messaging.netty.server_worker_threads	1
storm.zookeeper.servers（zk集群中各服务器地址）	192.168.195.199,192.168.195.201,192.168.195.202
transactional.zookeeper.root	/transactional
topology.acker.executors
topology.transfer.buffer.size	1024
topology.worker.childopts
drpc.queue.size	128
worker.childopts	-Xmx768m
supervisor.heartbeat.frequency.secs（supervisor心跳频率，单位以秒计算）	5
topology.error.throttle.interval.secs	10
zmq.hwm	0
drpc.port（在使用drpc服务时，drpc server的服务端口）	3772
supervisor.monitor.frequency.secs	3
drpc.childopts	-Xmx768m
topology.receiver.buffer.size	8
task.heartbeat.frequency.secs	3
topology.tasks
storm.messaging.netty.max_retries	100
topology.spout.wait.strategy	backtype.storm.spout.SleepSpoutWaitStrategy
nimbus.thrift.max_buffer_size	1048576
topology.max.spout.pending
storm.zookeeper.retry.interval	1000
topology.sleep.spout.wait.strategy.time.ms	1
nimbus.topology.validator	backtype.storm.nimbus.DefaultTopologyValidator
supervisor.slots.ports（supervisor节点上slots端口号，一个supervisor节点默认有四个slots，其端口号默认分别是6700,6701,6702,6703）	6700,6701,6702,6703
topology.debug	false
nimbus.task.launch.secs	120
nimbus.supervisor.timeout.secs	60
topology.message.timeout.secs	30
task.refresh.poll.secs	10
topology.workers(每个Topology运行时的worker的默认数目，默认值是1，若在代码中设置，则此选项值被覆盖)	1
supervisor.childopts	-Xmx256m
nimbus.thrift.port	6627
topology.stats.sample.rate	0.05
worker.heartbeat.frequency.secs	1
topology.tuple.serializer	backtype.storm.serialization.types.ListDelegateSerializer
topology.disruptor.wait.strategy	com.lmax.disruptor.BlockingWaitStrategy
topology.multilang.serializer	backtype.storm.multilang.JsonSerializer
nimbus.task.timeout.secs	30
storm.zookeeper.connection.timeout	15000
topology.kryo.factory	backtype.storm.serialization.DefaultKryoFactory
drpc.invocations.port	3773
logviewer.port	8000
zmq.threads	1
storm.zookeeper.retry.times	5
topology.worker.receiver.thread.count	1
storm.thrift.transport	backtype.storm.security.auth.SimpleTransportPlugin
topology.state.synchronization.timeout.secs	60
supervisor.worker.timeout.secs	30
nimbus.file.copy.expiration.secs	600
storm.messaging.transport	backtype.storm.messaging.netty.Context
logviewer.appender.name	A1
storm.messaging.netty.max_wait_ms	1000
drpc.request.timeout.secs	600
storm.local.mode.zmq	false
ui.port（nimbus节点上ui页面端口号，默认是8080）	8080
nimbus.childopts	-Xmx1024m
storm.cluster.mode	distributed
topology.max.task.parallelism（每个top运行时最大的executor数）
storm.messaging.netty.transfer.batch.size	262144

Storm UI

Topology summary

Name	Id	Status	Uptime	Num workers	Num executors	Num tasks
FirstStorm201409230942	FirstStorm201409230942-3-1411436633	ACTIVE	7h 35m 36s	28	3	28

Topology stats

Window	Emitted	Transferred	Complete latency (ms)	Acked	Failed
10m 0s	40	40	0.000	0	0
3h 0m 0s	40	40	0.000	0	0
1d 0h 0m 0s	40	40	0.000	0	0
All time	40	40	0.000	0	0