Differences

This shows you the differences between two versions of the page.

--- nlp:statistical_machine_translation [2021/04/20 08:13] – [Software] jmflanig
+++ nlp:statistical_machine_translation [2023/06/15 07:36] (current) – external edit 127.0.0.1
@@ Line 3: / Line 3: @@
 ===== Overviews =====
-  * {{papers:survey-staistical-machine-translation_0.pdf|Lopez 2008 - Statistical Machine Translation}} or [[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.126.2845&rep=rep1&type=pdf|Lopez 2007 - A Survey of Statistical Machine Translation]] (nicer formatting)
+  * {{papers:survey-staistical-machine-translation_0.pdf|Lopez 2008 - Statistical Machine Translation}} or [[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.126.2845&rep=rep1&type=pdf|Lopez 2007 - A Survey of Statistical Machine Translation]] (older, but nicer formatting)
 ===== IBM Models and Alignment =====
@@ Line 11: / Line 11: @@
     * IBM's complete system: [[https://patentimages.storage.googleapis.com/8c/d3/08/74a381b7127df4/US5477451.pdf|pdf]] [[https://patents.google.com/patent/US5477451A/en|patent]]
   * [[https://www.aclweb.org/anthology/C96-2141.pdf|Vogel et al 1996 - HMM-Based Word Alignment in Statistical Translation ]]
-  * ReWrite decoder: [[https://www.aclweb.org/anthology/P01-1030.pdf|Germann et al 2001 - Fast Decoding and Optimal Decoding for Machine Translation]]
+  * [[https://dl.acm.org/doi/pdf/10.3115/976909.979664|Wang & Waibel 1997 - Decoding Algorithm in Statistical Machine Translation]]
+  * ReWrite decoder: [[https://www.aclweb.org/anthology/P01-1030.pdf|Germann et al 2001 - Fast Decoding and Optimal Decoding for Machine Translation]] A* search, hillclimbing, and ILP for decoding for word-based models
   * [[https://www.aclweb.org/anthology/N03-1019.pdf|Kumar & Byrne 2003 - A Weighted Finite State Transducer Implementation of the Alignment Template Model for Statistical Machine Translation]]
+  * [[https://www.aclweb.org/anthology/N09-2002.pdf|Riedel & Clark 2009 - Revisiting Optimal Decoding for Machine Translation IBM Model 4]] Uses an ILP for IBM model 4
   * Concavity of IBM model 1: [[https://www.aclweb.org/anthology/N12-1069.pdf|Gimpel & Smith 2012]]
   * [[https://www.aclweb.org/anthology/N13-1073.pdf|Dyer et al 2013 - A Simple, Fast, and Effective Reparameterization of IBM Model 2]]
+  * [[https://arxiv.org/pdf/2004.14675.pdf|Zenkel et al 2020 - End-to-End Neural Word Alignment Outperforms GIZA++]] Not conclusive, since didn't do an extrinsic evaluation in an SMT system.  Often, improvements in alignment eror rate (AER) don't translate to better SMT models
 ===== Phrase-Based Machine Translation (PBMT) ====
@@ Line 22: / Line 25: @@
 ===== Syntax-Based Methods =====
+  * [[https://www.aclweb.org/anthology/P04-1083.pdf|Melamed 2004 - Statistical Machine Translation by Parsing]] Introduces SCFGs for SMT
   * Hiero
     * [[https://www.aclweb.org/anthology/P05-1033.pdf|Chiang 2005 - A Hierarchical Phrase-Based Model for Statistical Machine Translation]]
@@ Line 28: / Line 32: @@
 ===== Training =====
-  * [[https://www.aclweb.org/anthology/P03-1021.pdf|Och 2003 - Minimum Error Rate Training in Statistical Machine Translation]] The standard method for training SMT systems since 2003
+  * MERT: [[https://www.aclweb.org/anthology/P03-1021.pdf|Och 2003 - Minimum Error Rate Training in Statistical Machine Translation]] The standard method for training SMT systems since 2003
+  * Hypergraph MERT: [[https://storage.googleapis.com/pub-tools-public-publication-data/pdf/35496.pdf|Kumar et al 2008 - Efficient Minimum Error Rate Training and Minimum Bayes-Risk Decoding for Translation Hypergraphs and Lattices]]
 ===== Evaluation =====
   * Metrics
-    * BLEU
+    * [[https://www.aclweb.org/anthology/P02-1040.pdf|Papineni et al 2001 - BLEU: a Method for Automatic Evaluation of Machine Translation]]
     * [[https://www.aclweb.org/anthology/W05-0909.pdf|Banerjee & Lavie 2005 - METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments]]
   * Methodology
     * [[https://www.aclweb.org/anthology/W04-3250.pdf|Koehn 2004 - Statistical Significance Tests for Machine Translation Evaluation]]
+    * [[https://www.aclweb.org/anthology/P11-2031.pdf|Clark et al 2011 - Better Hypothesis Testing for Statistical Machine Translation: Controlling for Optimizer Instability]]
 ===== Software =====