Leslie-心蓝

Normalization TechniquesMotivation: Why needs Normalization?Normalization has always been an active area of research in deep learning. There are some benefits of it:It reduces Internal Covariate Shift. It is the change in the distribution of network ac

Label smoothing and MixupLabel SmoothingWhy needs Label SmoothingLabel SmoothingConclusionMixupNotes for popular regularization methods used in deep learning.Label SmoothingLabel smoothing is a mechanism to regularize the classifier layer by estimating