[环境报错] libcublas.so.11: undefined symbol: cublasLtGetStatusString, version libcublasLt.so.11

项目场景：

Traceback (most recent call last):
File “/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torch/init.py”, line 172, in _load_global_deps
ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
File “/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/ctypes/init.py”, line 364, in init
self._handle = _dlopen(self._name, mode)
OSError: /home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torch/lib/…/…/nvidia/cublas/lib/libcublas.so.11: undefined symbol: cublasLtGetStatusString, version libcublasLt.so.11

During handling of the above exception, another exception occurred:

问题描述

conda虚拟环境

python：3.7.10
torch：1.13.1
torchstat 0.0.7
torchsummary 1.5.1
torchaudio：0.13.1
torchvision：0.14.1

完整报错信息：

Traceback (most recent call last):
  File "/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torch/__init__.py", line 172, in _load_global_deps
    ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
  File "/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/ctypes/__init__.py", line 364, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: /home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torch/lib/../../nvidia/cublas/lib/libcublas.so.11: undefined symbol: cublasLtGetStatusString, version libcublasLt.so.11

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "test.py", line 1, in <module>
    from torchstat import stat
  File "/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torchstat/__init__.py", line 6, in <module>
    from torchstat.compute_memory import compute_memory
  File "/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torchstat/compute_memory.py", line 1, in <module>
    import torch.nn as nn
  File "/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torch/__init__.py", line 217, in <module>
    _load_global_deps()
  File "/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torch/__init__.py", line 178, in _load_global_deps
    _preload_cuda_deps()
  File "/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/torch/__init__.py", line 158, in _preload_cuda_deps
    ctypes.CDLL(cublas_path)
  File "/home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/ctypes/__init__.py", line 364, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: /home/zz/anaconda3/envs/Pipeline_py37/lib/python3.7/site-packages/nvidia/cublas/lib/libcublas.so.11: undefined symbol: cublasLtGetStatusString, version libcublasLt.so.11

解决方案：

pip uninstall nvidia_cublas_cu11