NLP Wiki

User Tools

Site Tools

Trace: • poem_generation • semeval • robustness_in_nlp • constituency_parsing • multilinguality • index • negative_results • entailment • instruction-tuning • dataset_creation
nlp:constituency_parsing

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
nlp:constituency_parsing [2021/10/25 03:55] – jmflanignlp:constituency_parsing [2023/07/03 19:00] (current) – jmflanig
Line 7: Line 7:
   * General Papers   * General Papers
     * See also [[https://en.wikipedia.org/wiki/CYK_algorithm|Wikipedia - CYK algorithm]]     * See also [[https://en.wikipedia.org/wiki/CYK_algorithm|Wikipedia - CYK algorithm]]
-  * Semi-ring parsing+  * Semi-ring parsing, see also [[Semiring]]
     * Goodman 1999     * Goodman 1999
   * Hypergraph parsing, see also [[Hypergraphs]]   * Hypergraph parsing, see also [[Hypergraphs]]
Line 15: Line 15:
     * Generalized CKY (CKY+).  Handles grammars not in CNF form (handles nplCF - non partially lexicalized CF grammars): [[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.18.811&rep=rep1&type=pdf|Chappelier & Rajman 1998 - A generalized CYK algorithm for parsing stochastic CFG]]     * Generalized CKY (CKY+).  Handles grammars not in CNF form (handles nplCF - non partially lexicalized CF grammars): [[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.18.811&rep=rep1&type=pdf|Chappelier & Rajman 1998 - A generalized CYK algorithm for parsing stochastic CFG]]
     * [[https://www.aclweb.org/anthology/W14-4011.pdf|Sennrich 2014 - A CYK+ Variant for SCFG Decoding Without a Dot Chart]] Improved CKY+ algorithm for SCFG parsing     * [[https://www.aclweb.org/anthology/W14-4011.pdf|Sennrich 2014 - A CYK+ Variant for SCFG Decoding Without a Dot Chart]] Improved CKY+ algorithm for SCFG parsing
-  * Re-Ranking Parser (using n-best from CKY)+  * Re-Ranking Parsers
     * [[https://aclanthology.org/P05-1022.pdf|Charniak & Johnson 2005 - Coarse-to-fine n-best parsing and MaxEnt discriminative reranking]]     * [[https://aclanthology.org/P05-1022.pdf|Charniak & Johnson 2005 - Coarse-to-fine n-best parsing and MaxEnt discriminative reranking]]
     * [[https://aclanthology.org/N06-1020.pdf|McClosky et al 2006 - Effective Self-Training for Parsing]]     * [[https://aclanthology.org/N06-1020.pdf|McClosky et al 2006 - Effective Self-Training for Parsing]]
 +    * [[https://aclanthology.org/P08-1067.pdf|Huang et al 2008 - Forest Reranking: Discriminative Parsing with Non-Local Feature]] 91.7 on PTB. Was SOTA until [[https://aclanthology.org/P12-1046.pdf|Shindo 2012]]
     * [[https://aclanthology.org/D16-1257.pdf|Choe & Charniak 2016 - Parsing as Language Modeling]]     * [[https://aclanthology.org/D16-1257.pdf|Choe & Charniak 2016 - Parsing as Language Modeling]]
   * Parsers Using CKY   * Parsers Using CKY
     * [[https://aclanthology.org/P14-1022.pdf|Hall et al 2014 - Less Grammar, More Features]]     * [[https://aclanthology.org/P14-1022.pdf|Hall et al 2014 - Less Grammar, More Features]]
   * Neural Parsers that use CKY   * Neural Parsers that use CKY
 +    * [[https://arxiv.org/pdf/1507.03641.pdf|Durrett & Klein 2015 - Neural CRF Parsing]]
 +    * [[https://arxiv.org/pdf/1705.03919.pdf|Stern et al 2017 - A Minimal Span-Based Neural Constituency Parser]]
     * [[https://arxiv.org/pdf/1804.07853.pdf|Gaddy et al 2018 - What's Going On in Neural Constituency Parsers? An Analysis]]     * [[https://arxiv.org/pdf/1804.07853.pdf|Gaddy et al 2018 - What's Going On in Neural Constituency Parsers? An Analysis]]
     * [[https://arxiv.org/pdf/1805.01052.pdf|Kitaev & Klein 2018 - Constituency Parsing with a Self-Attentive Encoder]]     * [[https://arxiv.org/pdf/1805.01052.pdf|Kitaev & Klein 2018 - Constituency Parsing with a Self-Attentive Encoder]]
 +    * [[https://arxiv.org/pdf/1911.03875.pdf|Mrini et al 2019 - Rethinking Self-Attention: Towards Interpretability in Neural Parsing]] Current SOTA (as of 2021)
     * [[https://arxiv.org/pdf/2008.03736.pdf|Zhang et al 2020 - Fast and Accurate Neural CRF Constituency Parsing]] ([[https://www.ijcai.org/Proceedings/2020/560/|talk]])     * [[https://arxiv.org/pdf/2008.03736.pdf|Zhang et al 2020 - Fast and Accurate Neural CRF Constituency Parsing]] ([[https://www.ijcai.org/Proceedings/2020/560/|talk]])
-    * [[https://arxiv.org/pdf/1911.03875.pdf|Mrini et al 2020 - Rethinking Self-Attention: Towards Interpretability in Neural Parsing]] Current SOTA (as of 2021) 
  
 === Other approaches === === Other approaches ===
Line 37: Line 40:
       * [[https://aclanthology.org/Q19-1005.pdf|Coavoux et al 2019 - Unlexicalized Transition-based Discontinuous Constituency Parsing]]       * [[https://aclanthology.org/Q19-1005.pdf|Coavoux et al 2019 - Unlexicalized Transition-based Discontinuous Constituency Parsing]]
       * [[https://proceedings.neurips.cc/paper/2020/file/f7177163c833dff4b38fc8d2872f1ec6-Paper.pdf|Yang & Deng 2020 - Strongly Incremental Constituency Parsing with Graph Neural Networks]]       * [[https://proceedings.neurips.cc/paper/2020/file/f7177163c833dff4b38fc8d2872f1ec6-Paper.pdf|Yang & Deng 2020 - Strongly Incremental Constituency Parsing with Graph Neural Networks]]
 +  * Top-Down Parsing
 +    * [[https://arxiv.org/pdf/1705.03919.pdf|Stern et al 2017 - A Minimal Span-Based Neural Constituency Parser]]
   * Sequence-to-Sequence Constituency Parsing   * Sequence-to-Sequence Constituency Parsing
-    * [[https://proceedings.neurips.cc/paper/2015/file/277281aada22045c03945dcb2ca6f2ec-Paper.pdf|Vinyals et al 2015 - Grammar as a Foreign Language]]+    * [[https://papers.nips.cc/paper/5635-grammar-as-a-foreign-language.pdf|Vinyals et al 2015 - Grammar as a Foreign Language]]
     * [[https://aclanthology.org/P18-2097.pdf|Suzuki et al 2018 - An Empirical Study of Building a Strong Baseline for Constituency Parsing]]     * [[https://aclanthology.org/P18-2097.pdf|Suzuki et al 2018 - An Empirical Study of Building a Strong Baseline for Constituency Parsing]]
   * Recurrent Neural Network Grammars (RNNG)   * Recurrent Neural Network Grammars (RNNG)
Line 44: Line 49:
   * Sequence labeling   * Sequence labeling
     * [[https://arxiv.org/pdf/1810.08994.pdf|Gómez-Rodríguez & Vilares 2018 - Constituent Parsing as Sequence Labeling]]     * [[https://arxiv.org/pdf/1810.08994.pdf|Gómez-Rodríguez & Vilares 2018 - Constituent Parsing as Sequence Labeling]]
 +  * Non-Parametric Bayesian Parsers
 +    * [[https://aclanthology.org/P12-1046.pdf|Shindo et al 2012 - Bayesian Symbol-Refined Tree Substitution Grammars for Syntactic Parsing]] 92.4 on PTB. Was SOTA until [[https://arxiv.org/pdf/1602.07776.pdf|Dyer 2016]] surpassed it.
  
 ===== Unsupervised Constituency Parsing ===== ===== Unsupervised Constituency Parsing =====
Line 49: Line 56:
 ==== Overviews ==== ==== Overviews ====
   * [[https://www.aclweb.org/anthology/2020.acl-main.300.pdf|Li et al 2020 - An Empirical Comparison of Unsupervised Constituency Parsing Methods]]   * [[https://www.aclweb.org/anthology/2020.acl-main.300.pdf|Li et al 2020 - An Empirical Comparison of Unsupervised Constituency Parsing Methods]]
 +  * **Good overview**: related work of [[https://www.aclweb.org/anthology/2020.tacl-1.15.pdf|Nishida 2020]] (Gives a good history of unsupervised parsing in the related work)
  
 ==== Papers ==== ==== Papers ====
   * [[https://arxiv.org/pdf/2010.02423.pdf|Shi et al 2020 - On the Role of Supervision in Unsupervised Constituency Parsing]]   * [[https://arxiv.org/pdf/2010.02423.pdf|Shi et al 2020 - On the Role of Supervision in Unsupervised Constituency Parsing]]
 +  * [[https://arxiv.org/pdf/2105.15021.pdf|Yang et al 2021 - Neural Bi-Lexicalized PCFG Induction]]
   * Image-Aided   * Image-Aided
   * Video-Aided   * Video-Aided
     * [[https://arxiv.org/pdf/2104.04369.pdf|Zhang et al 2021 - Video-aided Unsupervised Grammar Induction]] (Best paper at NAACL 2021)     * [[https://arxiv.org/pdf/2104.04369.pdf|Zhang et al 2021 - Video-aided Unsupervised Grammar Induction]] (Best paper at NAACL 2021)
 +
 +===== People =====
 +  * [[https://scholar.google.com/citations?user=faXAgZQAAAAJ&hl=en|Zhenghua Li]]
  
 ===== Related Pages ===== ===== Related Pages =====
   * [[Dependency Parsing]]   * [[Dependency Parsing]]
  
nlp/constituency_parsing.1635134116.txt.gz · Last modified: 2023/06/15 07:36 (external edit)
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki