Link Search Menu Expand Document

A tentative plan for the schedule (topics, deadlines, etc.) is available here.

Schedule (subject to change as the term progresses)

Aug 22
Course Introduction
Eisenstein Chapter 1
Aug 24
Machine Learning - naive Bayes [lecture note]
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Aug 25
Problem Set 0 due
Aug 29
Machine Learning - logistic regression
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Aug 31
Machine Learning - Perceptron, SVM, multiclass [lecture note]
Eisenstein 2.0-2.5, 4.1,4.3-4.5, J+M 5
Sep 2
Project 0 due
Sep 5
no class - labor day
Sep 7
Neural Networks - Feedforward [lecture note]
Eisenstein 2.6, 3.1-3.3, J+M 7, Goldberg 1-4
Sep 12
Neural Networks - Backpropagation, optimization
Eisenstein 2.6, 3.1-3.3, J+M 7, Goldberg 1-4
Resource
PyTorch Tutorial (w/ links to Colab notebook)
Sep 13
Problem Set 1 due
Sep 14
Word Embeddings, Course Project
Eisenstein 3.3.4, 14.5, 14.6, J+M 6, Goldberg 5
Sep 19
Sequence Models - HMM, Viterbi [lecture note]
Eisenstein 7.0-7.4, J+M 8
Sep 21
Conditional Random Fields
Eisenstein 7.5, 8.3
Sep 26
Conditional Random Fields (cont’) [lecture note]
Eisenstein 7.5, 8.3
Sep 27
Project 1 due
Sep 28
Recurrent Neural Networks
Eisenstein 7.6, Goldberg 10-11, J+M 9.2, 9.3
Oct 3
Convolutional Neural Networks + Neural CRFs
Eisenstein 3.4, 7.6, Goldberg 9
Oct 5
Machine Translation
Eisenstein 18.1, 18.2
Oct 7
Problem Set 2 due
Oct 10
Encoder-Decoder + Attention
Eisenstein 18.3 - 18.5
Oct 12
No class - Course Project Proposal due (instructions on Gradescope)
Oct 17
No class - Fall Break
Oct 19
No class - reading day
Oct 24
Project 2 due - updated 10/11, refresh!
Oct 26
Neural MT + Generation
Wu+16 Google NMT, Holtzman+19 Degeneration
Oct 31
In-class Midterm
Nov 2
Copy/Pointer + Transformer
Vaswani+17 Transformers, Alammar’s blog post, Rush’s tutorial
Nov 7
Pretrained Language Models
ELMo BERT
Nov 9
Pretrained Language Models (cont’) + Ethics
BART, T5, PaLM
Nov 14
Dialogue
J+M Chapter 24, Wizard of Wikipedia
Nov 16
Question Answering
J+M Chapter 23, UnifiedQA
Nov 21
Guest Lecture - Colin Cherry (Google Research)
Nov 21
Project 3 due
Nov 23
No class - Thanksgiving
Nov 28
Multilingual / Cross-lingual Models
XLM-RoBERTa, TyDiQA
Nov 30
Guest Lecture - Jack Hessel (AI2)
Dec 5
No class
Dec 9
[Final Project Presentation (2:40-5:30pm, same classroom)]
Dec 9
Presentation Reports Due (submit on Gradescope - no late days allowed)