吴恩达Coursera深度学习课程 DeepLearning.ai 编程作业——Convolution model:step by step and application (4.1)

一.Convolutional Neural Networks: Step by Step

Welcome to Course 4’s first assignment! In this assignment, you will implement convolutional (CONV) and pooling (POOL) layers in numpy, including both forward propagation and (optionally) backward propagation.

Notation:

• Superscript $[l]$ denotes an object of the $l^{th}$ layer.

  • Example: $a^{[4]}$ is the $4^{th}$ layer activation. $W^{[5]}$ and $b^{[5]}$ are the $5^{th}$ layer parameters.

• Superscript $(i)$ denotes an object from the $i^{th}$ example.

  • Example: $x^{(i)}$ is the $i^{th}$ training example input.

• Lowerscript $i$ denotes the $i^{th}$ entry of a vector.

  • Example: $a_i^{[l]}$ denotes the $i^{th}$ entry of the activations in layer $l$, assuming this is a fully connected (FC) layer.

• $n_H$, $n_W$ and $n_C$ denote respectively the height, width and number of channels of a given layer. If you want to reference a specific layer $l$, you can also write $n_H^{[l]}$, $n_W^{[l]}$, $n_C^{[l]}$.

• $n_{H_{prev}}$, $n_{W_{prev}}$ and $n_{C_{prev}}$ denote respectively the height, width and number of channels of the previous layer. If referencing a specific layer $l$, this could also be denoted $n_H^{[l-1]}$, $n_W^{[l-1]}$, $n_C^{[l-1]}$.

We assume that you are already familiar with numpy and/or have completed the previous courses of the specialization. Let’s get started!

1 - Packages

Let’s first import all the packages that you will need during this assignment.

• numpy is the fundamental package for scientific computing with Python.
• matplotlib is a library to plot graphs in Python.
• np.random.seed(1) is used to keep all the random function calls consistent. It will help us grade your work.

import numpy as np
import h5py
import matplotlib.pyplot as plt

plt.rcParams["figure.figsize"]=(5.0,4.0)
plt.rcParams["image.interpolation"]='nearest'
plt.rcParams["image.cmap"]='gray'

np.random.seed(1)

2 - Outline of the Assignment

You will be implementing the building blocks of a convolutional neural network! Each function you will implement will have detailed instructions that will walk you through the steps needed:

• Convolution functions, including:
  • Zero Padding
  • Convolve window
  • Convolution forward
  • Convolution backward (optional)
• Pooling functions, including:
  • Pooling forward
  • Create mask
  • Distribute value
  • Pooling backward (optional)

This notebook will ask you to implement these functions from scratch in numpy. In the next notebook, you will use the TensorFlow equivalents of these functions to build the following model:

Note that for every forward function, there is its corresponding backward equivalent. Hence, at every step of your forward module you will store some parameters in a cache. These parameters are used to compute gradients during backpropagation.

3 - Convolutional Neural Networks