wusecaiyun的专栏

1. The second term is a regularization term (also called a weight decay term) that tends to decrease the magnitude of the weights, and helps prevent overfitting. you may also recognize this weigh

1.Whenever possible, avoid using explicit for-loops in your code. 2.Thus, for your first few programs, you might choose to first implement your algorithm without too many vectorization tricks, and

In the neural network terminology: one epoch = one forward pass and one backward pass of all the training examples batch size = the number of training examples in one forward/backward pass.