Trafodion Troubleshooting-java.lang.Out OfMemoryError: unable to create new native thread

最新推荐文章于 2021-08-30 08:00:00 发布

数据源的港湾

最新推荐文章于 2021-08-30 08:00:00 发布

阅读量497

点赞数 2

CC 4.0 BY-SA版权

分类专栏： QianBase/EsgynDB诊断 QianBase/EsgynDB/Trafodion

本文链接：https://blog.youkuaiyun.com/Post_Yuan/article/details/105202361

QianBase/EsgynDB/Trafodion 同时被 2 个专栏收录

263 篇文章

订阅专栏

QianBase/EsgynDB诊断

65 篇文章

订阅专栏

本文详细记录了EsgynDB数据库在运行过程中遇到的OutOfMemoryError异常，具体表现为无法创建新的本地线程。通过调整mxosrvr的heapsize设置，将JVM_MAX_HEAP_SIZE_MB参数从128增加到1024，并在所有节点上同步此更改，成功解决了问题。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

现象

EsgynDB节点的sql日志中报错java.lang.Out OfMemoryError: unable to create new native thread，具体信息如下，

2020-03-27 23:22:28,910, ERROR, SQL.EXE, Node Number: 0, CPU: 0, PIN: 45539, Process Name: $Z0000001DG3,,,Java exception in File:../executor/HBaseClient_JNI.cpp, Line:
7329 Method:HTableClient_JNI::fetchRows() TableName:TRAFODION.SCHEMANAME.TABLENAME java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.Out
OfMemoryError: unable to create new native thread
java.util.concurrent.FutureTask.report(FutureTask.java:122)
java.util.concurrent.FutureTask.get(FutureTask.java:192)
org.trafodion.sql.HTableClient.fetchRows(HTableClient.java:1323) Caused by
java.lang.RuntimeException: java.lang.OutOfMemoryError: unable to create new native thread
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:218)
org.apache.hadoop.hbase.client.ClientSmallScanner.loadCache(ClientSmallScanner.java:259)
org.apache.hadoop.hbase.client.ClientSmallScanner.next(ClientSmallScanner.java:233)
org.apache.hadoop.hbase.client.AbstractClientScanner.next(AbstractClientScanner.java:70)
org.trafodion.sql.HTableClient$ScanHelper.call(HTableClient.java:305)
org.trafodion.sql.HTableClient$ScanHelper.call(HTableClient.java:303)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748) Caused by
java.lang.OutOfMemoryError: unable to create new native thread
java.lang.Thread.start0(Native Method)
java.lang.Thread.start(Thread.java:717)
java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:957)
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1367)
org.apache.hadoop.hbase.client.ResultBoundedCompletionService.submit(ResultBoundedCompletionService.java:171)
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.addCallsForCurrentReplica(ScannerCallableWithReplicas.java:322)
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:187)
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:62)
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
org.apache.hadoop.hbase.client.ClientSmallScanner.loadCache(ClientSmallScanner.java:259)
org.apache.hadoop.hbase.client.ClientSmallScanner.next(ClientSmallScanner.java:233)
org.apache.hadoop.hbase.client.AbstractClientScanner.next(AbstractClientScanner.java:70)
org.trafodion.sql.HTableClient$ScanHelper.call(HTableClient.java:305)
org.trafodion.sql.HTableClient$ScanHelper.call(HTableClient.java:303)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)

解决

从报错信息看，是因为OutOfMemory导致无法创建native thread，于是怀疑可能是mxosrvr的heap size设置不够，查看ms.env中JVM_MAX_HEAP_SIZE_MB发现值设置为128。

[trafodion@node01 trafodion]$ cat ms.env| grep HEAP
JVM_MAX_HEAP_SIZE_MB=128
ESP_JVM_MAX_HEAP_SIZE_MB=128

改为1024并同步各节点后重启数据库。