一日一坑之：hadoop3.x VS hbase2.2.x

最新推荐文章于 2023-11-21 21:46:03 发布

原创

最新推荐文章于 2023-11-21 21:46:03 发布 · 1.2k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#hbase异常 #hbase坑 #hbase hmaster启动断掉 #hmaster启动就断开 #hbase启动没有hmaster

本文记录了在使用最新版HBase 2.2.1过程中遇到的两个常见问题及其解决办法。一是由于Hadoop根节点配置不当导致的连接拒绝错误，通过修改hbase.rootdir属性添加端口号得以解决；二是WAL依赖于hsync但文件系统不支持的问题，通过调整配置参数增强系统健壮性。

为了适配我什么都想用最新的强迫性格，在搭建hbase过程中，应用了最新的hbase2.2.1版本的包，拿出珍藏已久的老版本安装文档，仔细安装，就在此时坑又来了。

首先对照了这几个表，查看下hbase和哪些jdk和hadoop匹配

可以查看这个网站，这里打印表不太容易看：

http://hbase.apache.org/book.html#basic.prerequisites

在第四个栏位

4. Basic Prerequisites

可以查询到

坑一：ERROR [master/hadoop1:16000:becomeActiveMaster] master.HMaster: Failed to become active master
java.net.ConnectException: Call From hadoop1/192.168.85.130 to hadoop1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki
.apache.org/hadoop/ConnectionRefused

错误信息：

019-09-29 14:02:50,500 WARN  [master/hadoop1:16000:becomeActiveMaster] ipc.Client: Failed to connect to server: hadoop1/192.168.85.130:8020: try once and fail.
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:685)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:788)
        at org.apache.hadoop.ipc.Client$Connection.access$3500(Client.java:410)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1550)
        at org.apache.hadoop.ipc.Client.call(Client.java:1381)
        at org.apache.hadoop.ipc.Client.call(Client.java:1345)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)
        at com.sun.proxy.$Proxy18.setSafeMode(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:691)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:409)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:163)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:155)
        at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:346)
at com.sun.proxy.$Proxy19.setSafeMode(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:372)
        at com.sun.proxy.$Proxy20.setSafeMode(Unknown Source)
        at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2143)
        at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:1359)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:287)
        at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:705)
        at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:252)
        at org.apache.hadoop.hbase.m

最低0.47元/天解锁文章