1 Optimization For Any Arbitary Neuron
This paper proposed some more explicit forms of regularization. Different hyperparameter combinations of these regularizations produce different styles of reconizable images.
.2.1 Clipping Pixels with Small Contribution
Contribution can be measured as
Where Ã(d, i, j) is the activation with a certain pi