Syllabus

Date	Topic	Readings (starred=graduate level)
Jan 28	Introduction	Koehn, chapter 1 Knight, Automating Knowledge Acquisition for Machine Translation Weaver, Translation Kay, Translation
Jan 30	Probability and Language Models	Koehn, chapters 2 and 7
Feb 04	Learning Translation Models: Word Alignment	Koehn, chapter 3 Knight, A Tutorial MT Workbook Collins, Statistical Machine Translation: IBM Models 1 and 2 Brown et al., A Statistical Approach to Machine Translation
Feb 06	Learning Better Translation Models Language in 10: German	Koehn, chapter 4 Brown et al., The Mathematics of Statical Machine Translation: Parameter Estimation Vogel and Ney, HMM-based word alignment in statistical translation Liang et al., Alignment by Agreement
Feb 11	Phrase-based alignment models	Koehn, chapter 5.1, 5.2, 5.5 Marcu and Wong, A Phrase-Based, Joint Probability Model for Statistical Machine Translation DeNero et al., Sampling Alignment Structure under a Bayesian Translation Model
Feb 13	Snow day	Germann et al., Fast Decoding and Optimal Decoding for Machine Translation Knight, Decoding Complexity in Word-Replacement Translation Models
Feb 18	In-class writing exercise Language in 10: Polari
Feb 20	Phrase-based translation Language in 10: Welsh	Koehn, sections 5.3 – 5.4 Koehn et al., Statistical Phrase-Based Translation
Feb 25	Stack decoding (Demo)	Koehn, chapter 6
Feb 27	Human evaluation of machine translation Language in 10: Finnish	Koehn, chapter 8 Papineni et al., Bleu: a Method for Automatic Evaluation of Machine Translation Callison-Burch et al., Re-Evaluating the Role of BLEU in Machine Translation Research
Mar 04	Automatic evaluation of machine translation
Mar 06	Feature-based models	Koehn, chapter 9
Mar 11	Loss-Sensitive Training of Feature-Based Models	Todd Balf, The Story Behind the SAT Overhaul Koehn, sections 9.1 – 9.3 Och, Minimum Error Rate Training in Statistical Machine Translation
Mar 13	Large-scale discriminative training of feature-based models Language in 10: Korean	Koehn, section 9.4 Cherry & Foster, Batch Tuning Strategies for Statistical Machine Translation Hopkins & May, Tuning as Ranking
Mar 18	Spring Break
Mar 20	Spring Break
Mar 25	Syntax-based Translation Part 1: Reordering for Phrase-Based Translation	Chiang, An Introduction to Synchronous Grammars Collins et al., Clause Restructuring for Statistical Machine Translation Twain, The Awful German Language
Mar 27	Syntax-Based Translation Part 2: Synchronous Grammars	Yamada and Knight, Syntax-based Statistical Machine Translation Heidi Fox, Phrasal Cohesion and Statistical Machine Translation Galley et al., What’s in a Translation Rule?
Apr 01	Syntax-Based Translation Part 3: Decoding as Parsing	Chiang, Hierarchical Phrase-based Translation Wu, Stochastic Inversion Transduction Grammars and Bilingual Parsing of Parallel Corpora
Apr 03	Translation with Weighted Automata	Knight and Al-Onaizan, Translation with Finite-State Devices Iglesias et al., Hierarchical Phrase-Based Translation with Weighted Finite State Transducers Iglesias et al., Hierarchical Phrase-Based Translation Representations
Apr 08	Computer-Aided Translation (Guest Lecture by Philipp Koehn)
Apr 10	Streaming Translation (Guest Lecture by Miles Osborne) Language in 10: American Sign Language	Talbot and Osborne, Smoothed Bloom filter language models: Tera-Scale LMs on the Cheap Levenberg, Callison-Burch, and Osborne, Stream-based Translation Models for Statistical Machine Translation Levenberg and Osborne, Stream-based Randomised Language Models for SMT
Apr 15	Representing Huge Translation Models	Callison-Burch et al., Scaling Phrase-Based Statistical Machine Translation to Larger Corpora and Longer Phrases Lopez, Hierarchical Phrase-Based Translation with Sufﬁx Arrays He et al., Massively Parallel Suffix Array Queries and On-Demand Phrase Extraction for Statistical Machine Translation Using GPUs
Apr 17	In-class writing exercise Language in 10: Turkish
Apr 22	Syntax-Based Language Modeling	Charniak et al., Syntax-based language models for statistical machine translation Shen et al., A New String-to-Dependency Machine Translatio Algorithm with a Target Dependency Language Model
Apr 24	Morphology and Translation	Koehn and Hoang, Factored Translation Models Toutanova et al., Applying Morphology Generation Models to Machine Translation
Apr 29	Neural Models in MT	Bengio et al., A Neural Probabilistic Language Model Kalchbrenner and Blunsom, Recurrent Continuous Translation Models
May 01	Semantics-Preserving Machine Translation	Jones et al., Semantics-Based Machine Translation with Hyperedge Replacement Grammars Zettlemoyer and Collins, Online Learning of Relaxed CCG Grammars for Parsing to Logical Form