Multilingual NLP

Date	Topic	Readings
Jan 17	Introduction, MT, and Large Language Models	Koehn (2010), Statistical Machine Translation, Chapter 4 Devlin et al. (2018), BERT Pre-training of Deep Bidirectional Transformers for Language Understanding Xue et al. (2021), mT5 A Massively Multilingual Pre-trained Text-to-Text Transformer
Jan 24	Multilingual Information Extraction, Multilingual Semantics	Bikel and Zitouni (2012), Multilingual Natural Language Processing Applications, Chapter 13 Yarmohammadi et al. (2021), Everything Is All It Take A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction Chen et al. (2022), Frustratingly Easy Label Projection for Cross-lingual Transfer Stengel-Eskin et al. (2021), Joint Universal Syntatic and Semantic Parsing
Jan 31	Multilingual Quesion Answering	Clark et al. (2020), TYDI QA A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages Xue et al. (2022), ByT5 Towards a Token-Free Future with Pre-trained Byte-to-Byte Models Radford et al. (2022), Robust Speech Recognition via Large-Scale Weak Supervision Ardila (2020), Common Voice A Massively-Multilingual Speech Corpus Hemphill et al. (1990), The ATIS Spoken Language Systems Pilot Corpus Faruqui and Hakkani-Tur (2022), Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systems
Feb 07	Project Proposals
Feb 14	Cross-Language Information Retrieval (CLIR), Multilingual Information Retrieval (MLIR)	Manning et al. (2008), Introduction to Infomation Retrieval, Chapter 1 Robertson and Sparck Jones (1976), Okapi BM 25 Nair et al. (2022), Transfer Learning Approaches for Building Cross-Language Dense Retrieval Models Lawrie et al. (2023), Neural Approaches to Multilingual Information Retrieval
Feb 21	Multilingual Automatic Speech Recognition (ASR) and Multilingual Spoken Language Understanding (SLU)
Feb 28	Typology and Phonology	Hammarstrom (2016), Linguistic Diversity and Language Evolution Arwedson et al. (1888), Dhi Fonetik Titcer Journal of the International Phonetic Association (1949), The Principles of the International Phonetic Association
Mar 13	Code-Switching and Low-Resource	NLLB Team (2022), No Language Left Behind Scaling Human-Centered Machine Translation McCarthy (2020), The Johns Hopkins University Bible Corpus 1600+ Tongues for Typological Exploration Poplack (1980), Sometimes I'll Start A Sentence in Spanish y Termino en Espanol Toward a Typology of Code-Switching
Mar 20	Cross-Language Information Retrieval (Guest Lecture by Eugene Yang)
Mar 27	Multilingual Semantics and Dialogue Systems	, , ,
Apr 03	Multilingual Image and Text	Liu et al. (2021), Visually Grounded Reasoning across Languages and Cultures
Apr 17	Multilingual Text-to-Speech	Oord et al. (2016), WaveNet A Generative Model for Raw Audio
Apr 24	Final Project Presentations and Putting It All Together