Fundamental of Natural Language Processing

Natural Language Processing

Title Code Difficulty Recommend Prerequisites
A Neural Probabilistic Language Model (2003) none ★★★ NN
Efficient Estimation of Word Representations in Vector Space (2013) official ★★★★ NN
Bag of Tricks for Efficient Text Classification (2016) official ★★☆ Word2Vec
Convolutional Neural Networks for Sentence Classification (2014) official ★★ CNN
Long Short Term Memory (1997) none ★★ ★★★★ RNN
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling (2014) none ★☆ ★★★ LSTM
Sequence to Sequence Learning with Neural Networks (2014) none ★★ ★★★☆ LSTM
Neural Machine Translation by Jointly Learning to Align and Translate (2016) none ★★★ ★★★☆ Seq2Seq
Attention Is All You Need (2017) official ★★★★★ ★★★★★ Attention
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2018) official ★★★★ ★★★★★ Transformers