Link Search Menu Expand Document

CS 7650 - Natural Language Processing

Georgia Institute of Technology

  • Instructor: Wei Xu
  • Piazza (announcements, questions, discussion)
  • Gradescope (homework assignments, submission and grading)

Schedule (subject to change as the term progresses)

Aug 23
Course Introduction
Eisenstein Chapter 1
Aug 25
Machine Learning
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Aug 30
Machine Learning (Problem Set 1 due)
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Sep 1
Machine Learning
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Sep 6
no class - Labor Day
Sep 8
Machine Learning - part 2
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Sep 13
Neural Networks in NLP
Eisenstein 2.6, 3.1-3.3, J+M 7, Goldberg 1-4
Sep 15
Neural Networks in NLP
Eisenstein 2.6, 3.1-3.3, J+M 7, Goldberg 1-4
Sep 20
Sequence Models
Eisenstein 7.0-7.4, J+M 8
Sep 20
Project 1 due
Sep 22
Conditional Random Fields
Eisenstein 7.5, 8.3
Sep 27
Word Embeddings
Eisenstein 3.3.4, 14.5, 14.6, J+M 6, Goldberg 5
Sep 29
Recurrent Neural Networks
J+M 9.2, 9.3, Eisenstein 7.6
Sep 30
Problem Set 2 due (template)
Oct 4
Convolutional Neural Networks + Neural CRFs
Eisenstein 3.4, 7.6 Goldberg 9
Oct 11
no class - Fall Break
Oct 13
Statistical Machine Translation
Eisenstein 18.1, 18.2
Oct 18
Encoder-Decoder Networks + Attention
Eisenstein 18.3 - 18.5
Oct 19
Project 2 due (github)
Oct 20
Neural Machine Translation
Eisenstein 18.3 - 18.5
Oct 25
Copy/Pointer Network + Self-Attention
Holtzman+19 Degeneration, Vaswani+17 Transformers
Oct 27
Transformer + Course Project
Alammar’s blog post, Rush’s tutorial
Nov 1
Information Extraction + Semantic Role Labeling
Eisenstein Chapters 13 & 17
Nov 5
Pretrained Language Models
ELMo BERT
Nov 8
Pretrained Language Models & Ethics (part 2)
BART, T5
Nov 10
Dialogue
J+M Chapter 24
Nov 15
guest lecture - Kenton Lee (Google AI) “Composing Tools for New Capabilities in NLP”
Nov 17
guest lecture - Avi Sil (IBM Research) “Multilingual Multi-domain Question Answering”
Nov 18
Project 3 due (github)
Nov 22
Question Answering
J+M Chapter 23
Nov 24
no class - Thanksgiving
Nov 29
guest lecture - Sudha Rao (Microsoft Research) “Teaching Machines to Ask Questions that Identify Missing Information in Different Scenarios”
Dec 1
Multilingual / Cross-lingual Models (part 2)
How multilingual is Multilingual BERT?
Dec 6
no class
Dec 13
Final Project Reports Due (submit on Gradescope - no late days allowed)