Advanced concepts, techniques, and applications of artificial intelligence, including knowledge representation, learning, natural language understanding, and vision.
Date | Topic | Required Reading | Suggested Reading |
---|---|---|---|
8/22 | Course Overview, Reinforcement Learning in NLP Research (Guest Lecture) | 3.1-3.4 | Microsoft Ms. PacMan |
TBD | Search Review | 3.5, 3.6 | Pancake Sorting |
TBD | Game Playing 1 - Minimax | 5.1, 5.2, 5.3, 5.4 | How Checkers was Solved |
TBD | Game Playing 2 - Expectimax and Utilities | 5.5, 13.1, 13.2, 16.1, 16.2, 16.3 | Rosen's note on Alpha Beta Pruning |
Reinforcement Learning | |||
TBD | Reinforcement Learning 1 - Markov Decision Processes | 17.1, 17.2 | |
TBD | Reinforcement Learning 2 - Value Iteration and Policy Iteration | 17.3 | Real-life examples of Markov Decision Processes |
TBD | Reinforcement Learning 3 - Temporal Difference Learning | 21.1, 21.2, 21.3 | Google AlphaGo |
TBD | Reinforcement Learning 4 - Q-Learning | 21.1, 21.2, 21.3 | |
TBD | Reinforcement Learning 5 - Function Approximation | 21.4 | Sutten & Barto's new reinforcement learning book (Ch. 5, 6, 13) |
TBD | Reinforcement Learning 6 - Policy Gradient Methods | 21.5, 21.6 | Deep Q-Learning |
Reasoning Under Uncertainty | |||
TBD | Probability Review | 13.3, 13.4, 13.5, 13.6 | Andrew Moore's tutorial and Jean Walrand's note on Probability |
TBD | Markov Models | 15.1, 15.2 | |
TBD | Midterm Review, Graphical Models in NLP Research (Guest Lecture) | ||
10/10 | Midterm (In class - close book and notes) | ||
TBD | Hidden Markov Models 1 - Monitoring and robot localization | 15.1, 15.2 | |
TBD | Hidden Markov Models 2 - Particle filtering and resampling | 15.3, 15.5 | |
TBD | Bayes Nets 1 - Probabilistic Representations | 14.1, 14.2 | |
TBD | Bayes Nets 2 - D-Seperation | 14.1, 14.2 | Olivier Chapelle's talk on Bayesian Network Click Model for Web Search |
TBD | Bayes Nets 3 - Inference | 14.4 | David Blei's talk on Topic Models and User Behavior |
TBD | Bayes Nets 4 - Sampling | 14.5 | |
Machine Learning and Special Topics | |||
TBD | Perceptron and Naive Bayes | 18.6 | |
TBD | Computer Vision 1 - Applications and CNNs | Facebook Accessibility | |
TBD | Computer Vision 2 - Deep Neural Networks and Visualization | 20.1, 20.2.1, 20.2.2 | Google DeepDream |
TBD | Final Review, Neural Networks in NLP Research (Guest Lecture) | Machine Translation class and book | |
TBD | Robotics Research | ||
TBD | Final Exam (close book and notes) |