This is a list of some good (well-written) papers in NLP.

• Introduction of a new method
  • Bahdanau et al 2014 - Neural Machine Translation by Jointly Learning to Align and Translate
  • Hu et al 2022 - In-Context Learning for Few-Shot Dialogue State Tracking
• Systematic exploration papers
  • Qi et al 2018 - When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?

Here are some papers that perhaps could have been better presented.

• Vaswani et al 2017 - Attention Is All You Need The main issue with the paper is it doesn't give any ablation studies or experimental justification of why they did the things they did. Even if they didn't have the computing resources to do ablation studies, they still could have shown the incremental improvements as they added improvements (for example, as in this paper) The paper is also written in a way that is hard to follow: slowly revealing the architecture without giving a good high-level overview at the beginning. It also doesn't clearly specify which parts of the architecture are new (they invented), and which parts are from somewhere else. For example, they invented multi-head attention, but they don't clearly state this.