NLP Wiki

User Tools

Site Tools

Trace: • membership_inference • vision_and_language
nlp:key_papers_in_nlp

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
nlp:key_papers_in_nlp [2022/10/13 00:28] – jmflanignlp:key_papers_in_nlp [2023/11/29 20:58] (current) – jmflanig
Line 25: Line 25:
   * Methods   * Methods
     * Attention: [[https://arxiv.org/pdf/1409.0473.pdf|Bahdanau et al 2014 - Neural Machine Translation by Jointly Learning to Align and Translate]]     * Attention: [[https://arxiv.org/pdf/1409.0473.pdf|Bahdanau et al 2014 - Neural Machine Translation by Jointly Learning to Align and Translate]]
 +    * Seq2seq: [[https://arxiv.org/pdf/1409.3215.pdf|Sutskever et al 2014 - Sequence to Sequence Learning with Neural Networks]]
     * BPE: [[https://arxiv.org/pdf/1508.07909.pdf|Sennrich et al 2016 - Neural Machine Translation of Rare Words with Subword Units]]     * BPE: [[https://arxiv.org/pdf/1508.07909.pdf|Sennrich et al 2016 - Neural Machine Translation of Rare Words with Subword Units]]
     * Transformer: [[https://arxiv.org/pdf/1706.03762.pdf|Vaswani et al 2017 - Attention Is All You Need]]     * Transformer: [[https://arxiv.org/pdf/1706.03762.pdf|Vaswani et al 2017 - Attention Is All You Need]]
-    * Seq2seq 2014 paper 
     * CRFs: [[https://repository.upenn.edu/cgi/viewcontent.cgi?article=1162&context=cis_papers|Lafferty et al 2001 - Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data]]     * CRFs: [[https://repository.upenn.edu/cgi/viewcontent.cgi?article=1162&context=cis_papers|Lafferty et al 2001 - Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data]]
     * Decoding     * Decoding
Line 36: Line 36:
     * QA: Squad v1, v2     * QA: Squad v1, v2
     * NLI: SNLI     * NLI: SNLI
 +    * Dialog: 
 +      * MultiWOZ:[[https://arxiv.org/pdf/1810.00278.pdf|Budzianowski et al 2018 - MultiWOZ - A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling]]
     * Information Extraction     * Information Extraction
       * Named Entity Recognition: [[https://aclanthology.org/W03-0419.pdf|Tjong et al 2003 - Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition]]       * Named Entity Recognition: [[https://aclanthology.org/W03-0419.pdf|Tjong et al 2003 - Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition]]
 +    * General Benchmarks
 +      * GLUE, SuperGLUE
 +      * MMMLU: [[https://arxiv.org/pdf/2009.03300.pdf|Hendrycks et al 2020 - Measuring Massive Multitask Language Understanding]]
   * Evaluation and Ethics   * Evaluation and Ethics
     * BLEU: [[https://aclanthology.org/P02-1040.pdf|Papineni et al 2002 - BLEU: a Method for Automatic Evaluation of Machine Translation]]     * BLEU: [[https://aclanthology.org/P02-1040.pdf|Papineni et al 2002 - BLEU: a Method for Automatic Evaluation of Machine Translation]]
Line 54: Line 59:
     * Transformer: [[https://arxiv.org/pdf/1706.03762.pdf|Vaswani et al 2017 - Attention Is All You Need]]     * Transformer: [[https://arxiv.org/pdf/1706.03762.pdf|Vaswani et al 2017 - Attention Is All You Need]]
   * Dialog   * Dialog
 +      * MultiWOZ:[[https://arxiv.org/pdf/1810.00278.pdf|Budzianowski et al 2018 - MultiWOZ - A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling]]
   * Question Answering (QA)   * Question Answering (QA)
     * Squad v1, v2     * Squad v1, v2
Line 64: Line 70:
       * [[https://arxiv.org/pdf/1603.01360.pdf|Lample et al 2016 - Neural Architectures for Named Entity Recognition]]       * [[https://arxiv.org/pdf/1603.01360.pdf|Lample et al 2016 - Neural Architectures for Named Entity Recognition]]
   * Methods   * Methods
-    * Seq2seq 2014 paper+    * Seq2seq: [[https://arxiv.org/pdf/1409.3215.pdf|Sutskever et al 2014 - Sequence to Sequence Learning with Neural Networks]]
     * CRFs: [[https://repository.upenn.edu/cgi/viewcontent.cgi?article=1162&context=cis_papers|Lafferty et al 2001 - Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data]]     * CRFs: [[https://repository.upenn.edu/cgi/viewcontent.cgi?article=1162&context=cis_papers|Lafferty et al 2001 - Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data]]
     * Decoding     * Decoding
Line 82: Line 88:
     * Batch and Layer Norm     * Batch and Layer Norm
     * Adam     * Adam
 +
 +===== Related Pages =====
 +  * [[History of NLP]]
  
nlp/key_papers_in_nlp.1665620927.txt.gz · Last modified: 2023/06/15 07:36 (external edit)
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki