1、全连接的神经网络结构
2、多分类神经网络的代价函数
J(Θ)=∑i=1m∑k=1Kyk(i)log(hΘ(x(i)))k+(1−yk(i))log(1−(hΘ(x(i)))k)+12m∑l=1L−1∑i=1sl∑j=1sl+1Θji(l)J(\Theta)=\sum_{i=1}^{m}\sum_{k=1}^{K}y^{(i)}_{k}log(h_{\Theta}(x^{(i)}))_{k}+(1-y_{k}^{(i)})log(1-(h_{\Theta}(x^{(i)}))_{k}) + \frac{1}{2m}\sum_{l=1}^{L-1}\sum_{i=1}^{s_{l}}\sum_{j=1}^{s_{l+1}}\Theta_{ji}^{(l)}J(Θ)=i=1∑mk=1∑Kyk(i)log(hΘ(x(i)))k+(1−yk(i))log(1−(hΘ(x(i)))k)+2m1l=1∑L−1i=1∑slj=1∑sl+1Θji(l)