Index

1. Natural Language Processing with Deeplearning
   1. Intro
   2. Deeplearning
   3. Why NLP is difficult
   4. Why Korean NLP is Hell
   5. Recent Trends
2. Hello PyTorch
   1. Intro
   2. How to install
   3. PyTorch tutorial
   4. TorchText
3. Word Sense Disambiguation (WSD)
   1. intro
   2. Bayes Theorem
   3. Naive Bayes
   4. Selectional Preference
   5. WordNet
4. Preprocessing
   1. Intro
   2. Collecting corpus
   3. Cleaning corpus
   4. Tokenization (POS Tagging)
   5. Aligning parallel corpus
   6. Subword Segmentation
   7. Detokenization
5. Word Embedding Vector
   1. Intro
   2. One-hot encoding
   3. Previous methods
   4. Word2Vec
   5. GloVe
   6. FastText
   7. Advanced embedding
6. Sequence Modeling
   1. Intro
   2. Hidden Markov Model
   3. Conditional Random Field
7. Recurrent Neural Network
   1. Vanila RNN
   2. Long Short Term Memory
   3. Gated Recurrent Unit
   4. Gradient Clipping
8. Text Classification
   1. Intro
   2. Naive Bayes
   3. Using CNN
   4. Using RNN
   5. Unsupervised Text Classification
9. Language Modeling
   1. Intro
   2. n-gram
   3. Perpexity
   4. n-gram Exercise (SRILM)
   5. Neural Network Language Model
   6. Applications
10. Neural Machine Translation
    1. Intro
    2. Sequence-to-Sequence
    3. Attention
    4. Input Feeding
    5. Search
    6. Evaluation
11. Advanced Topic on NMT
    1. Multilingual NMT
    2. Using Monolingual Corpora
    3. Fully Convolutional Seq2seq
    4. Transformer
    5. MemDec
12. Reinforcement Learning for NLP
    1. Intro
    2. Policy Gradient
    3. Actor Critic
    4. SeqGAN
    5. Supervised NMT
    6. Unsupervised NMT
13. Exploit Duality
    1. Duality
    2. Dual Unsupervised Learning
    3. Dual Supervised Learning
14. Productization of NMT
    1. NMT pipeline
    2. Google's NMT
    3. Edinburgh's NMT
    4. Microsoft's NMT
15. Speech Recognition
    1. Intro
    2. Traditional methodology
    3. Seq2seq
16. Advanced Topic
    1. Memory Augmented Neural Network
       • Text Summarization
       • Quetional Answering
    2. Dynamic Memory Network