spark任务中报连接不到hbase的错误

最新推荐文章于 2023-11-30 16:05:52 发布

leebhing

最新推荐文章于 2023-11-30 16:05:52 发布

阅读量4.4k

点赞数

分类专栏： spark 文章标签： spark

本文链接：https://blog.youkuaiyun.com/leehbing/article/details/78481128

版权

在Spark任务执行过程中遇到了无法连接到HBase的问题，错误信息显示为'Connection refused'。问题可能出在ZooKeeper连接上，ZooKeeper尝试连接localhost的2181端口失败。尝试解决方法包括检查网络连接、ZooKeeper和HBase配置，以及使用'--file'参数提交Spark作业。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

17/10/16 20:51:22 INFOzookeeper.ClientCnxn: Opening socket connection to serverlocalhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknownerror)

17/10/16 20:51:22 WARNzookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closingsocket connection and attempting reconnect

java.net.ConnectException: Connectionrefused

atsun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

atsun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)

atorg.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

atorg.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

17/10/16 20:51:22 WARNzookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper,quorum=localhost:2181,exception=org.apache.zookeeper.KeeperException$ConnectionLossException:KeeperErrorCode = ConnectionLoss for /hbase/meta-region-server

17/10/16 20:51:22 INFO zookeeper.ClientCnxn:Opening socket connection to server localhost/127.0.0.1:2181. Will not attemptto authenticate using SASL (unknown error)

17/10/16 20:51:22 ERRORzookeeper.RecoverableZooKeeper: ZooKeeper getData failed after 4 attempts

17/10/16 20:51:22 WARN zookeeper.ZKUtil:hconnection-0x49e549d20x0, quorum=localhost:2181, baseZNode=/hbase Unable toget data of znode /hbase/meta-region-server

org.apache.zookeeper.KeeperException$ConnectionLossException:KeeperErrorCode = ConnectionLoss for /hbase/meta-region-server

atorg.apache.zookeeper.KeeperException.create(KeeperException.java:99)

atorg.apache.zookeeper.KeeperException.create(KeeperException.java:51)

atorg.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)

atorg.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getData(RecoverableZooKeeper.java:360)

atorg.apache.hadoop.hbase.zookeeper.ZKUtil.getData(ZKUtil.java:685)

atorg.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionState(MetaTableLocator.java:374)

atorg.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionLocation(MetaTableLocator.java:133)

atorg.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:438)