, Status : FAILED
Error:Java heap space
解决方法:
设置合适的mapred.child.java.opts,我设置成400m解决此问题,但是设置为300m仍然出错。
<property>
<name>mapred.child.java.opts</name>
<value>-Xmx400m</value>
<description>Java opts for the task tracker child processes.
The following symbol, if present, will be interpolated: @taskid@ is replaced
by current TaskID. Any other occurrences of '@' will go unchanged.
For example, to enable verbose gc logging to a file named for the taskid in
/tmp and to set the heap maximum to be a gigabyte, pass a 'value' of:
-Xmx1024m -verbose:gc -Xloggc:/tmp/@taskid@.gc
The configuration variable mapred.child.ulimit can be used to control the
maximum virtual memory of the child processes.
</description>
</property>
参考自:http://www.mail-archive.com/common-user@hadoop.apache.org/msg05128.html
本文介绍了解决Hadoop中遇到的Java堆内存溢出错误的方法。通过调整mapred.child.java.opts参数,将-Xmx设置为400m成功解决了问题,而设置为300m仍会报错。此外还提供了配置示例,包括如何启用详细的GC日志记录。
658

被折叠的 条评论
为什么被折叠?



