zookeeper-hbase启动报错

最新推荐文章于 2024-05-26 21:08:30 发布

原创最新推荐文章于 2024-05-26 21:08:30 发布 · 1.6k 阅读

4 ·

CC 4.0 BY-SA版权

文章标签：

#hbase #zookeeper #hadoop

大数据同时被 2 个专栏收录

3 篇文章

订阅专栏

Hadoop

1 篇文章

订阅专栏

本文详细记录了一次HBase集群启动过程中遇到的连接失败问题，深入分析了HBase与ZooKeeper通信异常的原因，并提供了具体的配置修改方案，确保hbase.rootdir与hadoop dfs.defaultFS的一致性。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

报错日志：
2020-03-13 22:34:34,826 INFO [main] mortbay.log: jetty-6.1.26
2020-03-13 22:34:35,959 INFO [main] mortbay.log: Started SelectChannelConnector@0.0.0.0:16010
2020-03-13 22:34:35,963 INFO [main] master.HMaster: hbase.rootdir=hdfs://master:9000/hbase, hbase.cluster.distributed=true
2020-03-13 22:34:36,018 INFO [main] master.HMaster: Adding backup master ZNode /hbase/backup-masters/master,16000,1584110066847
2020-03-13 22:34:36,374 INFO [master:16000.activeMasterManager] master.ActiveMasterManager: Deleting ZNode for /hbase/backup-masters/master,16000,1584110066847 from backup master directory
2020-03-13 22:34:36,406 INFO [master:16000.activeMasterManager] master.ActiveMasterManager: Registered Active Master=master,16000,1584110066847
2020-03-13 22:34:36,489 INFO [master/master/192.168.233.129:16000] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x71acdf40 connecting to ZooKeeper ensemble=master:2181,slave1:2181,slave2:2181,slave3:2181
2020-03-13 22:34:36,489 INFO [master/master/192.168.233.129:16000] zookeeper.ZooKeeper: Initiating client connection, connectString=master:2181,slave1:2181,slave2:2181,slave3:2181 sessionTimeout=90000 watcher=hconnection-0x71acdf400x0, quorum=master:2181,slave1:2181,slave2:2181,slave3:2181, baseZNode=/hbase
2020-03-13 22:34:36,524 INFO [master/master/192.168.233.129:16000-SendThread(slave2:2181)] zookeeper.ClientCnxn: Opening socket connection to server slave2/192.168.233.131:2181. Will not attempt to authenticate using SASL (unknown error)
2020-03-13 22:34:36,527 INFO [master/master/192.168.233.129:16000-SendThread(slave2:2181)] zookeeper.ClientCnxn: Socket connection established to slave2/192.168.233.131:2181, initiating session
2020-03-13 22:34:36,582 INFO [master/master/192.168.233.129:16000-SendThread(slave2:2181)] zookeeper.ClientCnxn: Session establishment complete on server slave2/192.168.233.131:2181, sessionid = 0x370d41997d10000, negotiated timeout = 40000
2020-03-13 22:34:36,605 FATAL [master:16000.activeMasterManager] master.HMaster: Failed to become active master
java.net.ConnectException: Call From master/192.168.233.129 to master:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730)
at org.apache.hadoop.ipc.Client.call(Client.java:1415)
at org.apache.hadoop.ipc.Client.call(Client.java:1364)
at org.apache.hadoop.ipc.ProtobufRpcEngine $I n v o k e r . i n v o k e (P r o t o b u f R p c E n g i n e . j a v a : 206) a t c o m . s u n . p r o x y .$ Proxy15.setSafeMode(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy15.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:602)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hbase.fs.HFileSystem $1 . i n v o k e (H F i l e S y s t e m . j a v a : 279) a t c o m . s u n . p r o x y .$ Proxy16.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:986)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:970)
at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525)
at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:429)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:153)
at org.apache.hadoop.hbase.master.MasterFileSystem.(MasterFileSystem.java:128)
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:693)
at org.apache.hadoop.hbase.master.HMaster.access$600(HMaster.java:189)
at org.apache.hadoop.hbase.master.HMaster $2 . r u n (H M a s t e r . j a v a : 1803) a t j a v a . l a n g . T h r e a d . r u n (T h r e a d . j a v a : 748) C a u s e d b y : j a v a . n e t . C o n n e c t E x c e p t i o n : C o n n e c t i o n r e f u s e d a t s u n . n i o . c h . S o c k e t C h a n n e l I m p l . c h e c k C o n n e c t (N a t i v e M e t h o d) a t s u n . n i o . c h . S o c k e t C h a n n e l I m p l . f i n i s h C o n n e c t (S o c k e t C h a n n e l I m p l . j a v a : 717) a t o r g . a p a c h e . h a d o o p . n e t . S o c k e t I O W i t h T i m e o u t . c o n n e c t (S o c k e t I O W i t h T i m e o u t . j a v a : 206) a t o r g . a p a c h e . h a d o o p . n e t . N e t U t i l s . c o n n e c t (N e t U t i l s . j a v a : 529) a t o r g . a p a c h e . h a d o o p . n e t . N e t U t i l s . c o n n e c t (N e t U t i l s . j a v a : 493) a t o r g . a p a c h e . h a d o o p . i p c . C l i e n t$ Connection.setupConnection(Client.java:606)
at org.apache.hadoop.ipc.Client $C o n n e c t i o n . s e t u p I O s t r e a m s (C l i e n t . j a v a : 700) a t o r g . a p a c h e . h a d o o p . i p c . C l i e n t$ Connection.accessInvoker.invoke(ProtobufRpcEngine.java:206)
at com.sun.proxy. $P r o x y 15 . s e t S a f e M o d e (U n k n o w n S o u r c e) a t s u n . r e f l e c t . N a t i v e M e t h o d A c c e s s o r I m p l . i n v o k e 0 (N a t i v e M e t h o d) a t s u n . r e f l e c t . N a t i v e M e t h o d A c c e s s o r I m p l . i n v o k e (N a t i v e M e t h o d A c c e s s o r I m p l . j a v a : 62) a t s u n . r e f l e c t . D e l e g a t i n g M e t h o d A c c e s s o r I m p l . i n v o k e (D e l e g a t i n g M e t h o d A c c e s s o r I m p l . j a v a : 43) a t j a v a . l a n g . r e f l e c t . M e t h o d . i n v o k e (M e t h o d . j a v a : 498) a t o r g . a p a c h e . h a d o o p . i o . r e t r y . R e t r y I n v o c a t i o n H a n d l e r . i n v o k e M e t h o d (R e t r y I n v o c a t i o n H a n d l e r . j a v a : 187) a t o r g . a p a c h e . h a d o o p . i o . r e t r y . R e t r y I n v o c a t i o n H a n d l e r . i n v o k e (R e t r y I n v o c a t i o n H a n d l e r . j a v a : 102) a t c o m . s u n . p r o x y .$ Proxy15.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:602)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hbase.fs.HFileSystem $1 . i n v o k e (H F i l e S y s t e m . j a v a : 279) a t c o m . s u n . p r o x y .$ Proxy16.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:986)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:970)
at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525)
at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:429)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:153)
at org.apache.hadoop.hbase.master.MasterFileSystem.(MasterFileSystem.java:128)
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:693)
at org.apache.hadoop.hbase.master.HMaster.access$600(HMaster.java:189)
at org.apache.hadoop.hbase.master.HMaster $2 . r u n (H M a s t e r . j a v a : 1803) a t j a v a . l a n g . T h r e a d . r u n (T h r e a d . j a v a : 748) C a u s e d b y : j a v a . n e t . C o n n e c t E x c e p t i o n : C o n n e c t i o n r e f u s e d a t s u n . n i o . c h . S o c k e t C h a n n e l I m p l . c h e c k C o n n e c t (N a t i v e M e t h o d) a t s u n . n i o . c h . S o c k e t C h a n n e l I m p l . f i n i s h C o n n e c t (S o c k e t C h a n n e l I m p l . j a v a : 717) a t o r g . a p a c h e . h a d o o p . n e t . S o c k e t I O W i t h T i m e o u t . c o n n e c t (S o c k e t I O W i t h T i m e o u t . j a v a : 206) a t o r g . a p a c h e . h a d o o p . n e t . N e t U t i l s . c o n n e c t (N e t U t i l s . j a v a : 529) a t o r g . a p a c h e . h a d o o p . n e t . N e t U t i l s . c o n n e c t (N e t U t i l s . j a v a : 493) a t o r g . a p a c h e . h a d o o p . i p c . C l i e n t$ Connection.setupConnection(Client.java:606)
at org.apache.hadoop.ipc.Client $C o n n e c t i o n . s e t u p I O s t r e a m s (C l i e n t . j a v a : 700) a t o r g . a p a c h e . h a d o o p . i p c . C l i e n t$ Connection.access $2800 (C l i e n t . j a v a : 367) a t o r g . a p a c h e . h a d o o p . i p c . C l i e n t . g e t C o n n e c t i o n (C l i e n t . j a v a : 1463) a t o r g . a p a c h e . h a d o o p . i p c . C l i e n t . c a l l (C l i e n t . j a v a : 1382) . . . 29 m o r e 2020 - 03 - 1322 : 34 : 36, 608 I N F O [m a s t e r : 16000 . a c t i v e M a s t e r M a n a g e r] r e g i o n s e r v e r . H R e g i o n S e r v e r : S T O P P E D : U n h a n d l e d e x c e p t i o n . S t a r t i n g s h u t d o w n . 2020 - 03 - 1322 : 34 : 36, 912 I N F O [m a s t e r / m a s t e r / 192.168.233.129 : 16000] r e g i o n s e r v e r . H R e g i o n S e r v e r : C l u s t e r I d : 0 d d 0199 a - e 6 a 2 - 4 a 82 - 8 b f 1 - b 30 a f 3 e 4 c 4 d a 2020 - 03 - 1322 : 34 : 36, 912 I N F O [m a s t e r / m a s t e r / 192.168.233.129 : 16000] r e g i o n s e r v e r . H R e g i o n S e r v e r : S t o p p i n g i n f o S e r v e r 2020 - 03 - 1322 : 34 : 37, 166 I N F O [m a s t e r / m a s t e r / 192.168.233.129 : 16000] m o r t b a y . l o g : S t o p p e d S e l e c t C h a n n e l C o n n e c t o r @ 0.0.0.0 : 160102020 - 03 - 1322 : 34 : 37, 175 I N F O [m a s t e r / m a s t e r / 192.168.233.129 : 16000] r e g i o n s e r v e r . H R e g i o n S e r v e r : s t o p p i n g s e r v e r m a s t e r, 16000, 15841100668472020 - 03 - 1322 : 34 : 37, 175 I N F O [m a s t e r / m a s t e r / 192.168.233.129 : 16000] c l i e n t . C o n n e c t i o n M a n a g e r$ HConnectionImplementation: Closing zookeeper sessionid=0x370d41997d10000
2020-03-13 22:34:37,222 INFO [master/master/192.168.233.129:16000] zookeeper.ZooKeeper: Session: 0x370d41997d10000 closed
2020-03-13 22:34:37,222 INFO [master/master/192.168.233.129:16000-EventThread] zookeeper.ClientCnxn: EventThread shut down
2020-03-13 22:34:37,225 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: stopping server master,16000,1584110066847; all regions closed.
2020-03-13 22:34:37,225 INFO [master/master/192.168.233.129:16000] hbase.ChoreService: Chore service for: master,16000,1584110066847 had [] on shutdown
2020-03-13 22:34:37,286 INFO [master/master/192.168.233.129:16000] ipc.RpcServer: Stopping server on 16000
2020-03-13 22:34:37,287 INFO [RpcServer.listener,port=16000] ipc.RpcServer: RpcServer.listener,port=16000: stopping
2020-03-13 22:34:37,341 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: stopped
2020-03-13 22:34:37,341 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: stopping
2020-03-13 22:34:37,373 INFO [master/master/192.168.233.129:16000] zookeeper.ZooKeeper: Session: 0x270d4199b500001 closed
2020-03-13 22:34:37,373 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: stopping server master,16000,1584110066847; zookeeper connection closed.
2020-03-13 22:34:37,373 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: master/master/192.168.233.129:16000 exiting
2020-03-13 22:34:37,373 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down
出现了HMaster进程，但是执行hbase shell报错，如下：
在这里插入图片描述
以上出现的原因--------个人分析：
在部署hbase集群时需要关闭自身的ZooKeeper使用外部的ZooKeeper，以上出现的问题主要是hbase与ZooKeeper之间的通信出现了问题。
解决方法：
1、在网上搜索一通，大部分都是下解决方案，应该能解决有些问题，但是没有解决我的；
https://blog.youkuaiyun.com/zhangchen124/article/details/92801139
2、我主要出现的问题是
hbase 的配置文件hbase-site.xml 中的 hbase.rootdir 值要与hadoop 配置文件core-site.xml 的dfs.Deafult 配置没有保持一致。
更改对应配置文件如下
core-site.xml中
在这里插入图片描述
hbase-site.xml中
在hbase-site.xml这里插入图片描述
重新启动hbase，start-hbase.sh