Multilingual NLP

Date	Topic	Readings
Jan 24	Introduction and MT	Koehn (2010), Statistical Machine Translation, Chapter 4
Jan 26	MT and Large Language Models	Devlin et al. (2018), BERT Pre-training of Deep Bidirectional Transformers for Language Understanding Xue et al. (2021), mT5 A Massively Multilingual Pre-trained Text-to-Text Transformer
Jan 31	Survey of Multilingual NLP
Feb 02	Multilingual Information Extraction	Bikel and Zitouni (2012), Multilingual Natural Language Processing Applications, Chapter 13 Yarmohammadi et al. (2021), Everything Is All It Take A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction Chen et al. (2022), Frustratingly Easy Label Projection for Cross-lingual Transfer
Feb 07	Project Proposal Presentations
Feb 09	Cross-Language Information Retrieval (CLIR)	Manning et al. (2008), Introduction to Infomation Retrieval, Chapter 1 Robertson and Sparck Jones (1976), Okapi BM 25 Nair et al. (2022), Transfer Learning Approaches for Building Cross-Language Dense Retrieval Models
Feb 14	Multilingual Information Retrieval (MLIR)	Lawrie et al. (2023), Neural Approaches to Multilingual Information Retrieval
Feb 16	Multilingual Spoken Language Understanding (SLU)	Hemphill et al. (1990), The ATIS Spoken Language Systems Pilot Corpus Faruqui and Hakkani-Tur (2022), Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systems
Feb 21	Multilingual Semantics (Guest Lecture by Elias Stengel-Eskin)	Stengel-Eskin et al. (2021), Joint Universal Syntatic and Semantic Parsing
Feb 23	Multilingual Question Answering	Clark et al. (2020), TYDI QA A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages
Feb 28	Multilingual QA (Methods)	Xue et al. (2022), ByT5 Towards a Token-Free Future with Pre-trained Byte-to-Byte Models
Mar 02	Typology	Hammarstrom (2016), Linguistic Diversity and Language Evolution
Mar 07	Bilingual Lexicon Induction (BLI) (Guest Lecture by Kelly Marchisio)
Mar 09	Code-Switching	Poplack (1980), Sometimes I'll Start A Sentence in Spanish y Termino en Espanol Toward a Typology of Code-Switching
Mar 14	Low-Resource	NLLB Team (2022), No Language Left Behind Scaling Human-Centered Machine Translation McCarthy (2020), The Johns Hopkins University Bible Corpus 1600+ Tongues for Typological Exploration
Mar 16	GPT-4	OpenAI (2023), GPT-4 Technical Report
Mar 28	Multilingual Dialogue Systems	Goel et al. (2023), PRESTO A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs
Mar 30	Mid-Point Project Presentations
Apr 06	Multilingual Representation Learning	Rudman et al. (2022), IsoScore Measuring the Uniformity of Embedding Space Utilization
Apr 11	Multilingual Automatic Speech Recognition	Radford et al. (2022), Robust Speech Recognition via Large-Scale Weak Supervision Ardila (2020), Common Voice A Massively-Multilingual Speech Corpus
Apr 13	Phonology	Arwedson et al. (1888), Dhi Fonetik Titcer Journal of the International Phonetic Association (1949), The Principles of the International Phonetic Association
Apr 20	Multilingual Text-to-Speech	Oord et al. (2016), WaveNet A Generative Model for Raw Audio
Apr 25	Putting It All Together
Apr 27	Final Project Presentations