Question 1 Consider the problem of predicting how well a student does in her second year of college/university, given how well she did in her first year. Specifically, let x be equ…
RNN(Recurrent NeuralNetwork)和LSTM(Long Short Term Memory) RNN(Recurrent NeuralNetwork) RNN:存在随着时间的流逝,信号会不断的衰弱(梯度消失) LSTM(Long Short Term Memory): 很好的解决梯度消失 控制信号的衰减 控制信号输出信号本身…
这几天围绕论文A Neural Probability Language Model 看了一些周边资料,如神经网络、梯度下降算法,然后顺便又延伸温习了一下线性代数、概率论以及求导。总的来说,学到不少知识。下面是一些笔记概要。 一、 神经网络 神经网络我之前听过无数次,但是没有正儿八经研究过。形象一点来说,神经网络就是人们模仿生物神经元…