14_ Sequence to Sequence

1 .

2 .

3 .

4 .

5 .

6 .Sequence to Sequence http://www.wildml.com/2016/01/attention-and-memory-in-deep-learning-and-nlp/

7 .Lecture 1 4 : NSML, Smartest ML Platform

8 .DNN, CNN, RNN http://practicalquant.blogspot.hk/2013/10/deep-learning-oral-traditions.html

9 .Exercise 13-1 Implement Neural Machine Translation by Jointly Learning to Align and Translate: https://arxiv.org/abs/1409.0473 C t https://arxiv.org/abs/1409.0473

10 .loss = 0 hidden = encoder(x) input = SOS for label in labels: hidden, output = model(hidden, input) loss += criterion(output, label) input = one_hot(output.max(1)) loss.backward() optimizer.step() Summary: S2S (WIP) y t y t-1 x l h t y 1