Link Search Menu Expand Document

CS 4650 - Natural Language Processing (Georgia Tech)

Georgia Institute of Technology

  • Instructor: Wei Xu
  • Lecture: Mondays, Wednesdays 3:30-4:45pm

Schedule (subject to change as the term progresses)

Jan 10
Course Introduction
Eisenstein Chapter 1
Jan 12
Machine Learning - part 1 [lecture note]
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Jan 13
Problem Set 0 due
Jan 17
no class - MLK Day
Jan 19
Machine Learning - part 1 (cont’)
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Jan 25 Jan 20
Project 0 due
Feb 3
Problem Set 1 due
TBA
Machine Learning - part 2
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
TBA
Neural Networks in NLP
Eisenstein 2.6, 3.1-3.3, J+M 7, Goldberg 1-4
TBA
PyTorch Tutorial (including links to Colab notebook)
TBA
Sequence Models
Eisenstein 7.0-7.4, J+M 8
TBA
Conditional Random Fields
Eisenstein 7.5, 8.3
TBA
Word Embeddings
Eisenstein 3.3.4, 14.5, 14.6, J+M 6, Goldberg 5
TBA
Recurrent Neural Networks
J+M 9.2, 9.3, Eisenstein 7.6
TBA
Convolutional Neural Networks + Neural CRFs
Eisenstein 3.4, 7.6 Goldberg 9
TBA
Statistical Machine Translation
Eisenstein 18.1, 18.2
TBA
Encoder-Decoder Networks + Attention
Eisenstein 18.3 - 18.5
TBA
Neural Machine Translation
Eisenstein 18.3 - 18.5
TBA
Copy/Pointer Network + Self-Attention
Holtzman+19 Degeneration, Vaswani+17 Transformers
TBA
Transformer + Course Project
Alammar’s blog post, Rush’s tutorial
TBA
Information Extraction + Semantic Role Labeling
Eisenstein Chapters 13 & 17
TBA
Pretrained Language Models
ELMo BERT
TBA
Pretrained Language Models (part 2) + Ethics
BART, T5
TBA
Dialogue
J+M Chapter 24
TBA
Question Answering
J+M Chapter 23
Apr 29
Final Project Reports Due (submit on Gradescope - no late days allowed)