Multilingual NLP

Date	Topic	Readings
Jan 23	Introduction and Large Language Models	Koehn (2010), Statistical Machine Translation, Chapter 4 Devlin et al. (2018), BERT Pre-training of Deep Bidirectional Transformers for Language Understanding Xue et al. (2021), mT5 A Massively Multilingual Pre-trained Text-to-Text Transformer
Jan 25	Cross-Lingual Information Extraction	Bikel and Zitouni (2012), Multilingual Natural Language Processing Applications, Chapter 13 Yarmohammadi et al. (2021), Everything Is All It Take A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction Chen et al. (2022), Frustratingly Easy Label Projection for Cross-lingual Transfer
Jan 30	Multilingual Spoken Language Understanding (SLU) AND Survey of Multilingual NLP (Introduce Class Project)	Hemphill et al. (1990), The ATIS Spoken Language Systems Pilot Corpus Faruqui and Hakkani-Tur (2022), Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systems
Feb 01	Multilingual Question Answering	Clark et al. (2020), TYDI QA A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages
Feb 06	Multilingual QA (Methods)	Xue et al. (2022), ByT5 Towards a Token-Free Future with Pre-trained Byte-to-Byte Models Wei et al. (2023), Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Feb 08	Cross-Language Information Retrieval (CLIR)	Manning et al. (2008), Introduction to Infomation Retrieval, Chapter 1 Robertson and Sparck Jones (1976), Okapi BM 25 Nair et al. (2022), Transfer Learning Approaches for Building Cross-Language Dense Retrieval Models
Feb 13	Project Proposal Presentations
Feb 15	Project Proposal Presentations
Feb 20	Multilingual Information Retrieval (MLIR)	Lawrie et al. (2023), Neural Approaches to Multilingual Information Retrieval
Feb 22	Typology	Hammarstrom (2016), Linguistic Diversity and Language Evolution
Feb 27	Multilingual Representation Learning	Rudman et al. (2022), IsoScore Measuring the Uniformity of Embedding Space Utilization
Feb 29	Bilingual Lexicon Induction (BLI) (Guest Lecture by Kelly Marchisio)
Mar 05	Code-Switching	Poplack (1980), Sometimes I'll Start A Sentence in Spanish y Termino en Espanol Toward a Typology of Code-Switching
Mar 07	Low-Resource NLP	NLLB Team (2022), No Language Left Behind Scaling Human-Centered Machine Translation McCarthy et al. (2020), The Johns Hopkins University Bible Corpus 1600+ Tongues for Typological Exploration
Mar 12	Multilingual Dialogue Systems	Goel et al. (2023), PRESTO A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs
Mar 14	Multilingual Semantics	Stengel-Eskin et al. (2021), Joint Universal Syntactic and Semantic Parsing
Mar 26	Multilingual Automatic Speech Recognition	Radford et al. (2022), Robust Speech Recognition via Large-Scale Weak Supervision Ardila (2020), Common Voice A Massively-Multilingual Speech Corpus
Mar 28	Phonology	Arwedson et al. (1888), Dhi Fonetik Titcer Journal of the International Phonetic Association (1949), The Principles of the International Phonetic Association
Apr 02	Multilingual Text-to-Speech	Oord et al. (2016), WaveNet A Generative Model for Raw Audio
Apr 04	Multilingual Image and Text	Liu et al. (2021), Visually Grounded Reasoning across Languages and Cultures
Apr 11	Multilingual Pronunciation (Guest Lecture Matthew Wiesner)	Wiesner et al. (2019), Zero-Shot Pronunciation Lexicons for Cross-Language Acoustic Model Transfer
Apr 16	Reinforcement Learning from Human Feedback (RLHF)	Lambert et al. (2023), The History and Risks of Reinforcement Learning and Human Feedback Latent Space Podcast (2024), The Origin and Future of RLHF the secret ingredient for ChatGPT with Nathan Lambert
Apr 18	Reinforcement Learning from Human Feedback (RLHF) (Continued)
Apr 23	Multilingual Bias and Fact Checking	Gupta and Srikumar (2021), X-FACT A New Benchmark Dataset for Multilingual Fact Checking
Apr 25	Putting It All Together
Apr 30	Final Project Presentations