DataNode自定义监控

采集路径：http://XXXXX:50075/jmx?qry=Hadoop:service=DataNode,name=*

一、DataNode性能信息（核心指标）

Hadoop:service=DataNode,name=DataNodeActivity-R720ip67-50010

Metric	Type(GAUGE,COUNTER)	类型	业务意义	备注
BytesWritten	COUNTER		Total number of bytes written to DataNode
BytesRead	COUNTER		Total number of bytes read from DataNode
BlocksWritten	COUNTER		Total number of blocks written to DataNode
BlocksRead	COUNTER		Total number of blocks read from DataNode
BlocksReplicated	COUNTER		Total number of blocks replicated
BlocksRemoved	COUNTER		Total number of blocks removed
BlocksVerified	COUNTER		Total number of blocks verified
BlockVerificationFailures	COUNTER		Total number of verifications failures
BlocksCached	GAUGE		Total number of blocks cached
BlocksUncached	GAUGE		Total number of blocks uncached
ReadsFromLocalClient	COUNTER		Total number of read operations from local client
ReadsFromRemoteClient	COUNTER		Total number of read operations from remote client
WritesFromLocalClient	COUNTER		Total number of write operations from local client
WritesFromRemoteClient	COUNTER		Total number of write operations from remote client
BlocksGetLocalPathInfo	COUNTER		Total number of operations to get local path names of blocks
FsyncCount	COUNTER		Total number of fsync
VolumeFailures	COUNTER		Total number of volume failures occurred
ReadBlockOpNumOps	COUNTER		Total number of read operations
ReadBlockOpAvgTime	GAUGE	ms	Average time of read operations in milliseconds
WriteBlockOpNumOps	COUNTER		Total number of write operations
WriteBlockOpAvgTime	GAUGE	ms	Average time of write operations in milliseconds
BlockChecksumOpNumOps	COUNTER		Total number of blockChecksum operations
BlockChecksumOpAvgTime	GAUGE	ms	Average time of blockChecksum operations in milliseconds
CopyBlockOpNumOps	COUNTER		Total number of block copy operations
CopyBlockOpAvgTime	GAUGE	ms	Average time of block copy operations in milliseconds
ReplaceBlockOpNumOps	COUNTER		Total number of block replace operations
ReplaceBlockOpAvgTime	GAUGE	ms	Average time of block replace operations in milliseconds
HeartbeatsNumOps	COUNTER		Total number of heartbeats
HeartbeatsAvgTime	GAUGE	ms	Average heartbeat time in milliseconds
BlockReportsNumOps	COUNTER		Total number of block report operations
BlockReportsAvgTime	GAUGE	ms	Average time of block report operations in milliseconds
CacheReportsNumOps	COUNTER		Total number of cache report operations
CacheReportsAvgTime	GAUGE	ms	Average time of cache report operations in milliseconds
PacketAckRoundTripTimeNanosNumOps	COUNTER		Total number of ack round trip
PacketAckRoundTripTimeNanosAvgTime	GAUGE	ms	Average time from ack send to receive minus the downstream ack time in nanoseconds
FlushNanosNumOps	COUNTER		Total number of flushes
FlushNanosAvgTime	GAUGE	ms	Average flush time in nanoseconds
FsyncNanosNumOps	COUNTER		Total number of fsync
FsyncNanosAvgTime	GAUGE	ms	Average fsync time in nanoseconds
SendDataPacketBlockedOnNetworkNanosNumOps	COUNTER		Total number of sending packets
SendDataPacketBlockedOnNetworkNanosAvgTime	GAUGE	ms	Average waiting time of sending packets in nanoseconds
SendDataPacketTransferNanosNumOps	COUNTER		Total number of sending packets
SendDataPacketTransferNanosAvgTime	GAUGE	ms	Average transfer time of sending packets in nanoseconds

 

二、DataNode JvmMetrics详细信息（核心指标）

Hadoop:service=DataNode,name=JvmMetrics

Metric	Type(GAUGE,COUNTER)	类型	业务意义	备注
GcCountParNew	COUNTER		新生代GC次数
GcTimeMillisParNew	COUNTER	ms	新生代GC耗时（ms）
GcCountConcurrentMarkSweep	COUNTER		老年代GC次数
GcTimeMillisConcurrentMarkSweep	COUNTER	ms	老年代GC耗时（ms）
GcCount	COUNTER		总的GC次数
GcTimeMillis	COUNTER	ms	总的GC耗时（ms）

 

三、DataNode空间信息（核心指标）

Hadoop:service=DataNode,name=FSDatasetState-null

Metric	Type(GAUGE,COUNTER)	类型	业务意义	备注
Capacity	GAUGE	GAUGE	DN容量
DfsUsed	GAUGE	GAUGE	DN已经使用的容量
NumFailedVolumes	GAUGE	GAUGE	DN坏卷的个数