【error】RuntimeError: cuda runtime error (59) : device-side assert triggered at /pytorch/torch/lib/TH

最新推荐文章于 2022-10-27 19:24:29 发布

codebrid

最新推荐文章于 2022-10-27 19:24:29 发布

阅读量1.2w

点赞数 1

CC 4.0 BY-SA版权

本文链接：https://blog.youkuaiyun.com/ccbrid/article/details/81019221

本文详细解析了PyTorch中使用index_select函数时出现的device-side assert触发错误，通过源代码定位问题所在，并给出了可能的解决方向。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

报错：

RuntimeError: cuda runtime error (59) : device-side assert triggered at /pytorch/torch/lib/THC/generic/THCTensorCopy.c:70

错误反馈：

/pytorch/torch/lib/THC/THCTensorIndex.cu:279: void indexSelectSmallIndex(TensorInfo<T, IndexType>, TensorInfo<T, IndexType>, TensorInfo<long, IndexType>, int, int, IndexType, long) [with T = long, IndexType = unsigned int, DstDim = 2, SrcDim = 2, IdxDim = -2]: block: [0,0,0], thread: [0,0,0] Assertion `srcIndex < srcSelectDimSize` failed.
/pytorch/torch/lib/THC/THCTensorIndex.cu:279: void indexSelectSmallIndex(TensorInfo<T, IndexType>, TensorInfo<T, IndexType>, TensorInfo<long, IndexType>, int, int, IndexType, long) [with T = long, IndexType = unsigned int, DstDim = 2, SrcDim = 2, IdxDim = -2]: block: [0,0,0], thread: [1,0,0] Assertion `srcIndex < srcSelectDimSize` failed.
/pytorch/torch/lib/THC/THCTensorIndex.cu:279: void indexSelectSmallIndex(TensorInfo<T, IndexType>, TensorInfo<T, IndexType>, TensorInfo<long, IndexType>, int, int, IndexType, long) [with T = long, IndexType = unsigned int, DstDim = 2, SrcDim = 2, IdxDim = -2]: block: [0,0,0], thread: [7,0,0] Assertion `srcIndex < srcSelectDimSize` failed.
THCudaCheck FAIL file=/pytorch/torch/lib/THC/generic/THCTensorCopy.c line=70 error=59 : device-side assert triggered
Traceback (most recent call last):  
  File "/users/pytorch/paper_image_caption/sz-spatial5-chunk/model_msoft_gh.py", line 211, in forward
    print(captions.index_select(1, Variable(self.num_step_id+1)).squeeze())
  ...
  File "/use/anaconda3/lib/python3.6/site-packages/torch/_tensor_str.py", line 271, in _vector_str
    fmt, scale, sz = _number_format(self)
  File "/user/anaconda3/lib/python3.6/site-packages/torch/_tensor_str.py", line 79, in _number_format
    tensor = torch.DoubleTensor(tensor.size()).copy_(tensor).abs_().view(tensor.nelement())
RuntimeError: cuda runtime error (59) : device-side assert triggered at /pytorch/torch/lib/THC/generic/THCTensorCopy.c:70

错误原因：

由前三行加粗位置以及报错位置可知错误出在 index_select函数的输入超出了范围。

/pytorch/torch/lib/THC/THCTensorIndex.cu:279: void indexSelectSmallIndex(TensorInfo<T, IndexType>, TensorInfo<T, IndexType>, TensorInfo<long, IndexType>, int, int, IndexType, long) [with T = long, IndexType = unsigned int, DstDim = 2, SrcDim = 2, IdxDim = -2]: block: [0,0,0], thread: [0,0,0] Assertion `srcIndex < srcSelectDimSize` failed.
/pytorch/torch/lib/THC/THCTensorIndex.cu:279: void indexSelectSmallIndex(TensorInfo<T, IndexType>, TensorInfo<T, IndexType>, TensorInfo<long, IndexType>, int, int, IndexType, long) [with T = long, IndexType = unsigned int, DstDim = 2, SrcDim = 2, IdxDim = -2]: block: [0,0,0], thread: [1,0,0] Assertion `srcIndex < srcSelectDimSize` failed.
/pytorch/torch/lib/THC/THCTensorIndex.cu:279: void indexSelectSmallIndex(TensorInfo<T, IndexType>, TensorInfo<T, IndexType>, TensorInfo<long, IndexType>, int, int, IndexType, long) [with T = long, IndexType = unsigned int, DstDim = 2, SrcDim = 2, IdxDim = -2]: block: [0,0,0], thread: [7,0,0] Assertion `srcIndex < srcSelectDimSize` failed.
THCudaCheck FAIL file=/pytorch/torch/lib/THC/generic/THCTensorCopy.c line=70 error=59 : device-side assert triggered
Traceback (most recent call last):
File "/users/pytorch/paper_image_caption/sz-spatial5-chunk/model_msoft_gh.py", line 211, in forward
print(captions.index_select(1, Variable(self.num_step_id+1)).squeeze())
File "/users/anaconda3/lib/python3.6/site-packages/torch/autograd/variable.py", line 119, in __repr__
return 'Variable containing:' + self.data.__repr__()
File "/us/anaconda3/lib/python3.6/site-packages/torch/tensor.py", line 133, in __repr__
return str(self)
File "/user/anaconda3/lib/python3.6/site-packages/torch/tensor.py", line 140, in __str__
return _tensor_str._str(self)
File "/user/anaconda3/lib/python3.6/site-packages/torch/_tensor_str.py", line 295, in _str
strt = _vector_str(self)
File "/use/anaconda3/lib/python3.6/site-packages/torch/_tensor_str.py", line 271, in _vector_str
fmt, scale, sz = _number_format(self)
File "/user/anaconda3/lib/python3.6/site-packages/torch/_tensor_str.py", line 79, in _number_format
tensor = torch.DoubleTensor(tensor.size()).copy_(tensor).abs_().view(tensor.nelement())
RuntimeError: cuda runtime error (59) : device-side assert triggered at /pytorch/torch/lib/THC/generic/THCTensorCopy.c:70