zjb18741809273的博客

自注意力机制代码（pytorch版）：import torchfrom torch import nnclass SelfAttention(nn.Module): """ self attention module""" def __init__(self, in_dim): super(SelfAttention, self).__init__() self.chanel_in = in_dim self.query = nn