hbase hregion server 异常退出排查

最新推荐文章于 2024-01-16 09:28:38 发布

xjping0794

最新推荐文章于 2024-01-16 09:28:38 发布

阅读量4.6k

点赞数

CC 4.0 BY-SA版权

分类专栏： hbase 文章标签： hbase

本文链接：https://blog.youkuaiyun.com/xjping0794/article/details/78376293

博客内容提到，在2017年10月25日23点01-03分，HBase的HRegionServer因发生多次长时间的GC（20秒左右），导致服务阻塞并无法响应外部请求。由于超过ZooKeeper的最大中断时间（40秒），ZooKeeper自动移除了该HBase节点。HBase在GC后尝试重新连接ZooKeeper，但由于未得到响应，最终导致服务异常退出。

---HBASE日志
2017-10-25 23:01:15,788 INFO [JvmPauseMonitor] util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 2907ms
GC pool 'ParNew' had collection(s): count=1 time=3312ms
2017-10-25 23:01:29,859 INFO [JvmPauseMonitor] util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 4569ms
GC pool 'ParNew' had collection(s): count=1 time=4746ms
2017-10-25 23:01:37,146 INFO [JvmPauseMonitor] util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 2285ms
GC pool 'ParNew' had collection(s): count=1 time=2530ms
2017-10-25 23:01:44,387 INFO [JvmPauseMonitor] util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 5240ms
GC pool 'ParNew' had collection(s): count=1 time=5417ms

2017-10-25 23:02:06,587 WARN [regionserver60020] util.Sleeper: We slept 22194ms instead of 3000ms, this is likely due to a long garbage collecting pause and it's usually bad, see http://hbase.apache.org/book.html#trouble.rs.runtime.zkexpired
2017-10-25 23:02:06,588 WARN [JvmPauseMonitor] util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 20200ms
GC pool 'ParNew' had collection(s): count=1 time=20520ms

2017-10-25 23:02:06,587 WARN [regionserver60020] util.Sleeper: We slept 22194ms instead of 3000ms, this is likely due to a long garbage collecting pause and it's usually bad, see http://hbase.apache.org/book.html#trouble.rs.runtime.zkexpired
2017-10-25 23:02:06,588 WARN [JvmPauseMonitor] util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 20200ms
GC pool 'ParNew' had collection(s): count=1