RNN-资料记录

图片粘贴不过来，.....

http://www.cnblogs.com/tornadomeet/p/3439503.html

http://deeplearning.net/tutorial/rnnrbm.html

http://en.wikipedia.org/wiki/Recurrent_neural_network

解决Long term问题

LSTM

理解lstm:中文版:http://www.jianshu.com/p/9dc9f41f0b29 英文版  http://colah.github.io/posts/2015-08-Understanding-LSTMs/

ESN:http://wenku.baidu.com/link?url=eqYJdsojGtsSQKdPXN6B73bs8t28xQhc50JHOn6_9RLzpQYmvcArDfUzoBxtErQ3dhT6xEO_ZneIvm9bFyfQpfd3zjUYYUJ_jj7fG7PhCvC

rnn应用：http://karpathy.github.io/2015/05/21/rnn-effectiveness/  && multimodel:文本描述图片 http://cs.stanford.edu/people/karpathy/deepimagesent/

clip gradient: https://www.zhihu.com/question/29873016

可运行例子：tensorflow rnn 例子：https://github.com/sherjilozair/char-rnn-tensorflow

tensorflow 安装：http://wiki.jikexueyuan.com/project/tensorflow-zh/get_started/os_setup.html

torch 安装：http://blog.topspeedsnail.com/archives/594

rnn tools:http://blog.youkuaiyun.com/apsvvfb/article/details/51015647

keras && theano && caffe && tensor flow && torch

理论篇：

RNN介绍：http://blog.youkuaiyun.com/heyongluoyao8/article/details/48636251

RNN以及LSTM的介绍和公式梳理 && BPTT  http://blog.youkuaiyun.com/Dark_Scope/article/details/47056361

http://www.cnblogs.com/neopenx/p/4623328.html

神经网络发展：http://www.zhihu.com/question/34681168

negative log liklihood:https://www.wikiwand.com/en/Likelihood_function