HBase运维笔记系列

这篇博客记录了在HBase运维过程中遇到的Zookeeper会话超时问题,详细分析了导致超时的原因,包括网络分区和长时间GC暂停,并给出了配置建议,如调整regionserver的超时时间以及设置合适的垃圾收集器参数,以避免 FULL GC 导致的 ZooKeeper 超时。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

2013-02-22 11:47:06,794 ERROR [STDERR] (http-0.0.0.0-8080-26) 13/02/22 11:47:06 INFO client.HConnectionManager$HConnectionImplementation: This client just lost it's session with ZooKeeper, will automatically reconnect when needed.
2013-02-22 11:47:06,794 ERROR [STDERR] (http-0.0.0.0-8080-26) 13/02/22 11:47:06 INFO client.HConnectionManager$HConnectionImplementation: ZK session expired. This disconnect could have been caused by a network partition or a long-running GC pause, either way it's recommended that you verify your environment.
2013-02-22 11:47:06,795 ERROR [STDERR] (http-0.0.0.0-8080-35) 13/02/22 11:47:06 ERROR zookeeper.ZooKeeperWatcher: hconnection-0x13cfb70ec0d0061 Received unexpected KeeperException, re-throwing exception
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:150)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:263)
        at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.checkIfBaseNodeAvailable(ZooKeeperNodeTracker.java:214)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.checkIfBaseNodeAvailable(HConnectionManager.java:702)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:633)
        at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:108)
        at com.newcosoft.hadoop.hbase.TestHBase.createTable(TestHBase.java:92)
        at com.newcosoft.hadoop.hbase.TestHBase.<init>(TestHBase.java:75)
        at com.newcosoft.hadoop.hbase.TestHBase.getInstance(TestHBase.java:85)
        at org.apache.jsp.testQueryHbase_jsp._jspService(testQueryHbase_jsp.java:53)


regionserver的超时时间需要设置为以下,防止FULL GC,带来的zookeeper超时
 
 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:CMSInitiatingOccupancyFraction=70"
<property>
    <name>hbase.regionserver.lease.period</name>
    <value>240000</value>
</property>
<property>
    <name>hbase.rpc.timeout</name>
    <value>280000</value>
</property>
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值