Hadoop-Hadoop集群模式搭建问题

最新推荐文章于 2024-08-04 13:23:56 发布

pfjia

最新推荐文章于 2024-08-04 13:23:56 发布

阅读量480

点赞数

分类专栏： Hadoop 文章标签： Hadoop 集群

本文链接：https://blog.youkuaiyun.com/jpf254/article/details/79826275

版权

背景

在云服务器上配置hadoop集群,参考Hadoop集群安装配置教程_Hadoop2.6.0_Ubuntu/CentOS,Hadoop: Setting up a Single Node Cluster.进行配置
使用一台腾讯云服务器作为master,其上配置namenode,secondary namenode,使用一台阿里云服务器作为slave1,其上配置datanode,两台服务器使用的都是centos 7.4 64位操作系统.

Problem connecting to server

按照网上资料配置hadoop集群,在master和slave1分别使用jps,可以发现,在两个云服务器上各线程都已启动,但是通过Web监控页发现,Live DataNode为0,查看slave1中的DataNode启动日志如下:

2018-04-05 17:14:02,236 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/111.230.135.74:8020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2018-04-05 17:14:03,244 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/111.230.135.74:8020. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2018-04-05 17:14: