weixin_42242159的博客

https://mp.weixin.qq.com/s?__biz=MzA3MzI4MjgzMw==&mid=2650754528&idx=5&sn=af9172c63da653dd8f6bec18c6e223f4&chksm=871a899eb06d008802709464f205d725d09935a118df797778dff28f3fd5a4907c81bd8...

单层 To initialize the weights of a single layer, use a function from torch.nn.init. For instance: conv1 = torch.nn.Conv2d(…) torch.nn.init.xavier_uniform(conv1.weight) Alternatively, you can modify the...

可以对梯度再次求导，用来惩罚梯度变化过快的情况。 也可以用来算Hessian矩阵。 官方举例说明： import torch from torchvision.models import resnet18 from torch.autograd import Variable model = resnet18().cuda() # dummy inputs for the example in...