how-to: resolve "java.lang.OutOfMemoryError: Java heap space" during using beeline && hiveserver2_internal error processing opensession-优快云博客

本文详细介绍了Hive连接HiveServer2时遇到Java堆空间不足错误的原因及解决方案，通过调整Hadoop配置文件中的堆大小参数来提升内存分配，避免连接失败。

Error log in hive.log file:

2015-06-10 00:33:18,207 ERROR [HiveServer2-Handler-Pool: Thread-47]: thrift.ProcessFunction (ProcessFunction.java:process(41)) - Internal error processing OpenSession
java.lang.OutOfMemoryError: Java heap space

This Error happened during connect hiveserver2 via beeline, both happened from hiveserver node and remote node. Command:
/opt/hive/bin/beeline -ujdbc:hive2://hostname:10000/datacenter_huke_firstp2p -nhadoop -phadoop

Root cause, the heapsize of hadoop opts is too small, need to increase the size in hive-env.sh as bold:
if [ "$SERVICE" = "cli" ]; then
   if [ -z "$DEBUG" ]; then
     export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -Xms10m -Xmx12288m -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:+UseParNewGC -XX:-UseGCOverheadLimit"
   else
     export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -Xms10m -Xmx12288m -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:-UseGCOverheadLimit"
   fi
fi

# The heap size of the jvm stared by hive shell script can be controlled via:
#
export HADOOP_HEAPSIZE=2048