Hadoop启动resourcemanager失败

最新推荐文章于 2024-03-20 11:09:56 发布

原创最新推荐文章于 2024-03-20 11:09:56 发布 · 2.2k 阅读

1 ·

CC 4.0 BY-SA版权

文章标签：

#resourcemanager

大数据专栏收录该内容

1 篇文章

订阅专栏

博客详细记录了Apache Hadoop YARN ResourceManager启动时遇到的错误，分析了错误原因，并提供了资源类型配置的正确示例。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

失败日志

2019-11-03 00:29:06,889 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: RM uses DefaultResourceCalculator which used only memory as resource-type but invalid resource-types specified 
{memory-mb=name: memory-mb, units: Mi, type: COUNTABLE, value: 0, minimum allocation: 1024, maximum allocation: 8192, vcores=name: vcores, units: , type: COUNTABLE, va
lue: 0, minimum allocation: 1, maximum allocation: 4, network=name: network, units: M, type: COUNTABLE, value: 0, minimum allocation: 0, maximum allocation: 9223372036
854775807}. Use DominantResourceCalculator instead to make effective use of these resource-types
        at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:352)
        at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:442)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:841)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1247)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:321)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1529)

产生原因：自定义的etc/hadoop/resource-types.xml文件中resource-type多了一个s（即写错为resource-types）

<configuration>

  <property>
    <name>yarn.resource-type</name>
    <value>network</value>
  </property>
  <property>
    <name>yarn.resource-type.network.units</name>
    <value>M</value>
  </property>
  <property>
    <name>yarn.resource-type.network.minimum</name>
    <value>1</value>
  </property>
  <property>
    <name>yarn.resource-type.network.maximum</name>
    <value>10</value>
  </property>

</configuration>