Yarn：Container is running beyond memory limits

最新推荐文章于 2024-06-27 12:58:57 发布

原创最新推荐文章于 2024-06-27 12:58:57 发布 · 335 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#yarn #nodemanager

大数据专栏专栏收录该内容

92 篇文章

订阅专栏

本文探讨了YARN中虚拟内存与物理内存使用比例超出预期的问题，分析了导致容器运行超限的原因，并提供了两种解决方案：一是禁用虚拟内存使用检查，二是调整虚拟内存与物理内存的比例设置。

There is a check placed at Yarn level for Virtual and Physical memory usage ratio. Issue is not only that VM doesn't have sufficient physical memory. But it is because Virtual memory usage is more than expected for given physical memory.

问题的原因是：虚拟内存的使用已经超过了物理内存配置比期望的内存。

It can be resolved either by :

Disable virtual memory usage check by setting yarn.nodemanager.vmem-check-enabled to false;
Increase VM:PM ratio by setting yarn.nodemanager.vmem-pmem-ratio to some higher value.

两种解决办法：

1. 关闭nodemanager虚拟内存检查项配置；

2. 调高虚拟内存和物理内存对应比率；

Add following property in yarn-site.xml

<property>
   <name>yarn.nodemanager.vmem-check-enabled</name>
    <value>false</value>
    <description>Whether virtual memory limits will be enforced for containers</description>
  </property>
 <property>
   <name>yarn.nodemanager.vmem-pmem-ratio</name>
    <value>4</value>
    <description>Ratio between virtual memory to physical memory when setting memory limits for containers</description>
  </property>

References :

https://issues.apache.org/jira/browse/HADOOP-11364

http://blog.cloudera.com/blog/2014/04/apache-hadoop-yarn-avoiding-6-time-consuming-gotchas/

https://stackoverflow.com/questions/21005643/container-is-running-beyond-memory-limits