transformer代码理解

nn.Embedding.from_pretrained：https://blog.youkuaiyun.com/do_you_ac_today/article/details/124620832
nn.ModuleList：https://blog.youkuaiyun.com/u014090429/article/details/112618607+代码写的挺好的
Tensor.expand(): 具体的还需要进一步研究，没研究透彻
laynorm：https://blog.youkuaiyun.com/Flag_ing/article/details/124278245
torch contiguous https://blog.youkuaiyun.com/qq_37828380/article/details/107855070
np triu https://blog.youkuaiyun.com/weixin_45193103/article/details/124006235
https://blog.youkuaiyun.com/weixin_34280060/article/details/123794009

torch gt https://blog.youkuaiyun.com/AlanxZhang/article/details/120640460
type_as https://blog.youkuaiyun.com/jzwong/article/details/103888839
torch.max: https://blog.youkuaiyun.com/weixin_43635550/article/details/100534904
https://blog.youkuaiyun.com/pearl8899/article/details/109229154
nn.conv1 https://blog.youkuaiyun.com/xu624735206/article/details/124961990 二三