Aims to be a compact list of the key papers in NLP.

• Machine Translation
• Dialog
• Question Answering
• Information Extraction
• Deep Learning
  • Ruder's 2016 paper

• Machine Translation
  • Brown et al 1993 - The Mathematics of Statistical Machine Translation: Parameter Estimation
• Parsing
  • Early work on Penn Treebank
  • ParsEval

Each paper is listed twice: sorted by broad areas or by topic.

• Methods
  • Attention: Bahdanau et al 2014 - Neural Machine Translation by Jointly Learning to Align and Translate
  • BPE: Sennrich et al 2016 - Neural Machine Translation of Rare Words with Subword Units
  • Transformer: Vaswani et al 2017 - Attention Is All You Need
  • Seq2seq 2014 paper
  • CRF paper
  • Decoding
  • BERT
  • GPT-2, GPT-3
• Datasets
  • Squad v1, v2
  • SNLI
• Evaluation and Ethics
  • BLEU: Papineni et al 2002 - BLEU: a Method for Automatic Evaluation of Machine Translation
  • Annotation artifacts
  • 2016 ethics paper
• Deep Learning
  • Dropout
  • Batch and Layer Norm
  • Adam

• Machine Translation
  • Attention: Bahdanau et al 2014 - Neural Machine Translation by Jointly Learning to Align and Translate
  • BPE: Sennrich et al 2016 - Neural Machine Translation of Rare Words with Subword Units
  • Transformer: Vaswani et al 2017 - Attention Is All You Need
• Dialog
• Question Answering
  • Squad v1, v2
• Natural Language Inference
  • SNLI
• Vision and Language
• Methods
  • Seq2seq 2014 paper
  • CRF paper
  • Decoding
• PreTraining, Language Models, and In-Context Learning
  • BERT
  • GPT-2, GPT-3
• Syntactic Parsing
• Semantic Parsing
• Evaluation and Ethics
  • BLEU: Papineni et al 2002 - BLEU: a Method for Automatic Evaluation of Machine Translation
  • Annotation artifacts
  • 2016 ethics paper
• Deep Learning
  • Dropout
  • Batch and Layer Norm
  • Adam