在hive中执行count时,报下面的错误
2018-01-19T14:22:01,035 ERROR [HiveServer2-Background-Pool: Thread-67] ql.Driver: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. PermGen space
2018-01-19T14:22:01,036 INFO [HiveServer2-Background-Pool: Thread-67] ql.Driver: Completed executing command(queryId=hadoop_20180119142150_fa0b75d4-b9f4-42b7-90a8-a4463e92362a); Time taken: 10.528 seconds
2018-01-19T14:22:01,396 ERROR [HiveServer2-Background-Pool: Thread-67] operation.Operation: Error running hive query:
org.apache.hive.service.cli.HiveSQLException: Error running query: java.lang.OutOfMemoryError: PermGen space
at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:262)
at org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91)
at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:334)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:347)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
命令jstat -gcutil
,命令解读参考 jstat命令查看jvm的GC情况 (以Linux为例)
下图是刚刚启动hiverserver2的时候
记一次hive的内存溢出(OutOfMemoryError: Java heap space)排查是个思路,但是不知道怎么去解决我的问题。
待解决。。。