CS 4650 - Natural Language Processing (Georgia Tech)
Georgia Institute of Technology
- Instructor: Wei Xu
- Lecture: Mondays, Wednesdays 3:30-4:45pm
Schedule (subject to change as the term progresses)
- Jan 10
- Course Introduction
- Eisenstein Chapter 1
- Jan 12
- Machine Learning - part 1 [lecture note]
- Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
- Jan 13
- Problem Set 0 due
- Jan 17
- no class - MLK Day
- Jan 19
- Machine Learning - part 1 (cont’)
- Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
- Jan 25
- Project 0 due
- Jan 24
- Machine Learning - part 2
- Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
- Jan 26
- Machine Learning - part 2 (cont’)
- Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
- Jan 31
- Neural Networks in NLP
- Eisenstein 2.6, 3.1-3.3, J+M 7, Goldberg 1-4
- Feb 2
- Neural Networks in NLP (cont’)
- Eisenstein 2.6, 3.1-3.3, J+M 7, Goldberg 1-4
- Feb 3
- Problem Set 1 due
- Feb 7
- Word Embeddings
- Eisenstein 3.3.4, 14.5, 14.6, J+M 6, Goldberg 5
- Feb 9
- Sequence Models [lecture note]
- Eisenstein 7.0-7.4, J+M 8
- Feb 14
- Conditional Random Fields [lecture note]
- Eisenstein 7.5, 8.3
- Feb 16
- Conditional Random Fields (cont’)
- Eisenstein 7.5, 8.3
- Feb 21
- Recurrent Neural Networks
- J+M 9.2, 9.3, Eisenstein 7.6
- Feb 22
- Project 1 due – file updated 2/5, refresh!
- PyTorch Tutorial (including links to Colab notebook)
- Feb 23
- Convolutional Neural Networks + Neural CRFs
- Eisenstein 3.4, 7.6 Goldberg 9
- Feb 28
- no class
- Mar 1
- Problem Set 2 due
- Mar 2
- Statistical Machine Translation
- Eisenstein 18.1, 18.2
- Mar 7
- Statistical Machine Translation (cont’)
- Eisenstein 18.1, 18.2
- Mar 9
- Encoder-Decoder + Attention [lecture note]
- Eisenstein 18.3 - 18.5
- Mar 11
- Project 2 due
- March 14
- Copy/Pointer Network + Transformer
- Vaswani+17 Transformers, Alammar’s blog post, Rush’s tutorial
- March 16
- Transformer (cont’) + Course Project
- Holtzman+19 Degeneration
- Mar 18
- Midterm due (released on Piazza/Gradescope)
- Mar 21
- no class - spring break
- Mar 23
- no class - spring break
- Mar 28
- Information Extraction + Semantic Role Labeling
- Eisenstein Chapters 13 & 17
- Mar 30
- Pretrained Language Models
- ELMo BERT
- Apr 4
- Pretrained Language Models (part 2) + Ethics
- BART, T5
- Apr 5
- Project 3 due
- Apr 6
- Dialogue
- J+M Chapter 24, Wizard of Wikipedia
- Apr 11
- Question Answering
- J+M Chapter 23
- Apr 13
- Guest Lecture by Luheng He (Google Research)
- Apr 18
- Multilingual / Cross-lingual Models
- XLM-RoBERTa
- Apr 29
- Final Project Reports Due (submit on Gradescope - no late days allowed)
