《一天搞懂深度学习-李宏毅》大纲

Lecture I : Introduction of Deep Learning

• Introduction of Deep Learning
  • Step1 : define a set of function
  • Step2 : goodness of function
  • Step3 : pick the best function
• Why Deep?
• "Hello World" for Deep Learning

Lecture II : Tips for Training Deep Neural Network

• Recipe of Deep Learning
  • Choosing proper loss
  • Mini-batch
  • New activation function
  • Adaptive Learning Rate
  • Momentum
  • Early Stopping
  • Weight Decay
  • Regularization
  • Dropout
  • Network Structure

Lecture III : Variants of Neural Network

• Convolutional Neural Network(CNN)
• Recurrent Neural Network(RNN)

Lecture IV : Next Wave

• Supervised Learning
  • Ultra Deep Network
  • Attention Model
• Reinforcement Learning
• Unsuperivised Learning
  • Image:Realizing what the World Looks Like
  • Text:Understanding the Meaning of Words
  • Audio:Learning human language without supervision