Hadoop启动resourcemanager失败

博客详细记录了Apache Hadoop YARN ResourceManager启动时遇到的错误,分析了错误原因,并提供了资源类型配置的正确示例。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

失败日志

2019-11-03 00:29:06,889 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: RM uses DefaultResourceCalculator which used only memory as resource-type but invalid resource-types specified 
{memory-mb=name: memory-mb, units: Mi, type: COUNTABLE, value: 0, minimum allocation: 1024, maximum allocation: 8192, vcores=name: vcores, units: , type: COUNTABLE, va
lue: 0, minimum allocation: 1, maximum allocation: 4, network=name: network, units: M, type: COUNTABLE, value: 0, minimum allocation: 0, maximum allocation: 9223372036
854775807}. Use DominantResourceCalculator instead to make effective use of these resource-types
        at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initScheduler(CapacityScheduler.java:352)
        at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.serviceInit(CapacityScheduler.java:442)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:841)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1247)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:321)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1529)

产生原因:自定义的etc/hadoop/resource-types.xml文件中resource-type多了一个s(即写错为resource-types)

<configuration>

  <property>
    <name>yarn.resource-type</name>
    <value>network</value>
  </property>
  <property>
    <name>yarn.resource-type.network.units</name>
    <value>M</value>
  </property>
  <property>
    <name>yarn.resource-type.network.minimum</name>
    <value>1</value>
  </property>
  <property>
    <name>yarn.resource-type.network.maximum</name>
    <value>10</value>
  </property>

</configuration>

备注:但是不写成resource-types,yarn配置network之后无法生效。。。不知道怎么搞这个

评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值