HA Yarn 启动 resourcemanager 闪退

解决YARN ResourceManager启动失败问题

最新推荐文章于 2024-10-07 11:47:17 发布

原创最新推荐文章于 2024-10-07 11:47:17 发布 · 1.3k 阅读

0 ·

CC 4.0 BY-SA版权

Hadoop 同时被 3 个专栏收录

10 篇文章

订阅专栏

zookeeper

4 篇文章

订阅专栏

Yarn

1 篇文章

订阅专栏

启动YARN的ResourceManager时遇到闪退问题，通过查看日志发现是由于配置错误导致。具体错误信息为：Embedded automatic failover is enabled, 但yarn.resourcemanager.zk-address未设置。解决方法是正确配置yarn.resourcemanager.zk-address。" 130550757,11183300,Matlab中BWO-BiLSTM模型优化数据分类预测,"['数据分类预测', 'BWO-BiLSTM', 'matlab编程', '神经网络', '机器学习']

执行命令start-yarn.sh 和 yarn-daemon.sh start resourcemanager，发现resourcemanager启动不了。
然后查询log，发现原来是配置文件有错误。

错误配置：

<property>
  <name>yarn.resourcemanager.zk.address</name>
  <value>hadoop01:2181,hadoop02:2181,hadoop03:2181</value>
</property>

正确配置：

<property>
  <name>yarn.resourcemanager.zk-address</name>
  <value>hadoop01:2181,hadoop02:2181,hadoop03:2181</value>
</property>

2019-12-05 10:23:23,451 INFO org.apache.hadoop.service.AbstractService: Service ResourceManager failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not set
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not set
at org.apache.hadoop.yarn.server.resourcemanager.EmbeddedElectorService.serviceInit(EmbeddedElectorService.java:70)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at org.apache.hadoop.yarn.server.resourcemanager.AdminService.serviceInit(AdminService.java:142)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:267)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2019-12-05 10:23:23,451 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to standby state
2019-12-05 10:23:23,451 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to standby state
2019-12-05 10:23:23,451 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not set
at org.apache.hadoop.yarn.server.resourcemanager.EmbeddedElectorService.serviceInit(EmbeddedElectorService.java:70)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at org.apache.hadoop.yarn.server.resourcemanager.AdminService.serviceInit(AdminService.java:142)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:267)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2019-12-05 10:23:23,459 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at hadoop02/192.168.216.112
************************************************************/