NLP Wiki

User Tools

Site Tools

Trace: • nn_tricks • rnn • non-autoregressive_seq2seq • morphological_analysis • seminars • corpus_analysis • human-in-the-loop
nlp:rnn

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
nlp:rnn [2021/04/29 10:02] – [Theoretical Properties] jmflanignlp:rnn [2023/07/30 18:14] (current) – [Related Pages] jmflanig
Line 7: Line 7:
   * [[https://arxiv.org/pdf/1805.04908.pdf|Weiss et al 2018 - On the Practical Computational Power of Finite Precision RNNs for Language Recognition]] Shows that RNN variants that can count are strictly more expressive than ones that cannot, and verifies this experimentally.   * [[https://arxiv.org/pdf/1805.04908.pdf|Weiss et al 2018 - On the Practical Computational Power of Finite Precision RNNs for Language Recognition]] Shows that RNN variants that can count are strictly more expressive than ones that cannot, and verifies this experimentally.
   * [[https://arxiv.org/pdf/2004.08500v1.pdf|Merrill et al 2020 - A Formal Hierarchy of RNN Architectures]] Interesting, but possibly incorrect in practice because the theoretical analysis is for saturated RNNs (related follow-up [[https://arxiv.org/pdf/2010.09697.pdf|here]]).   * [[https://arxiv.org/pdf/2004.08500v1.pdf|Merrill et al 2020 - A Formal Hierarchy of RNN Architectures]] Interesting, but possibly incorrect in practice because the theoretical analysis is for saturated RNNs (related follow-up [[https://arxiv.org/pdf/2010.09697.pdf|here]]).
 +  * [[https://www.aclweb.org/anthology/2020.emnlp-main.156.pdf|Hewitt et al 2020 - RNNs can generate bounded hierarchical languages with optimal memory]]
 +
 +=== People ===
 +  * [[https://scholar.google.com/citations?user=9y9ALCQAAAAJ&hl=en|Michael Hahn]]
  
 ===== Converting RNNs to WFSAs ===== ===== Converting RNNs to WFSAs =====
 See [[WFSA#Converting RNNs to WFSAs]] See [[WFSA#Converting RNNs to WFSAs]]
 +
 +===== Related Pages =====
 +  * [[Seq2seq]]
 +  * [[ml:State-Space Models]]
 +  * [[WFSA]]
  
nlp/rnn.1619690568.txt.gz · Last modified: 2023/06/15 07:36 (external edit)
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki