hadoop mapreduce经常OOM

最新推荐文章于 2021-08-07 11:27:48 发布

原创最新推荐文章于 2021-08-07 11:27:48 发布 · 256 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#大数据 #java

本文详细解析了Hadoop中mapred.child.java.opts属性的作用，包括如何设置子进程的Java选项来调整最大堆内存，以及如何通过配置实现垃圾回收日志记录等功能。

<property>
<name>mapred.child.java.opts</name>
<value>-Xmx512m</value>//默认200m
<description>Java opts for the task tracker child processes.
The following symbol, if present, will be interpolated: @taskid@ is replaced
by current TaskID. Any other occurrences of '@' will go unchanged.
For example, to enable verbose gc logging to a file named for the taskid in
/tmp and to set the heap maximum to be a gigabyte, pass a 'value' of:
-Xmx1024m -verbose:gc -Xloggc:/tmp/@taskid@.gc

The configuration variable mapred.child.ulimit can be used to control the
maximum virtual memory of the child processes.
</description>
</property>