OMP: Error #34: System unable to allocate necessary resources for OMP thread

Thinker_and_FKer

于 2020-04-21 13:25:41 发布

阅读量3.2k

点赞数 2

本文链接：https://blog.youkuaiyun.com/weixin_39123145/article/details/105656015

版权

用TensorFlow训练时有时候会出现这种错误：

OMP: Error #34: System unable to allocate necessary resources for OMP thread:
OMP: System error #11: Resource temporarily unavailable
OMP: Hint: Try decreasing the value of OMP_NUM_THREADS.
Aborted (core dumped)

这种情况往往是因为正在运行的程序开了太多GPU线程，占用了太多cpu资源。这样反倒使得运行效率降低，还影响新的程序运行。可以在训练脚本的开头加上这几行限制线程数：

import os
os.environ["MKL_NUM_THREADS"] = '4'
os.environ["NUMEXPR_NUM_THREADS"] = 4'
os.environ["OMP_NUM_THREADS"] = '4'