CSE 5522 Artificial Intelligence II: Advanced Techniques

Advanced concepts, techniques, and applications of artificial intelligence, including knowledge representation, learning, natural language understanding, and vision.

Details
Textbook:
Grading

Participation (5%)

You will receive credit for engaging in class discussion, asking and answering questions related to the homework on Piazza online discussion board.

Homeworks (15%)

Written homeworks will be very short (one or two exam-style questions) and will be graded in a good/mediocre/incomplete basis. You should be prepared to do regular work each week to keep up with the material and the assignments. Homeworks due before class on day X will include topics we will discuss in class on day X. We will talk about solution in class if people have questions. Homework assignments may NOT be turned in late. Homeworks are NOT accepted by email. There will be 1 grace homework grade per semester, that is, each student receiving full credit for the lowest or a missing homework grade.

Projects (30%)

Programming projects will be in Python, and should be submitted to Carmen by 11:59pm on the day it is due (unless otherwise instructed). Each student will have 3 flexible days to turn in late homework throughout the semester. As an example, you could turn in the first homework 2 days late and the second homework 1 day late without any penalty. After that you will loose 20% for each day the homework is late. Please email your homework to the instructor in case there are any technical issues with submission.

Midterm (20%)

Midterm exam will be close book and notes.

Final Exam (30%)

Final exam will be close book and notes.

Grading Scale: Numerical grades will be mapped to letter grades using the standard OSU policy: 93-100 (A), 90-92.9 (A-), 87-89.9 (B+), 83-86.9 (B), 80-82.9 (B-), 77-79.9 (C+), 73-76.9 (C), 70-72.9 (C-), 67-69.9 (D+), 60-66.9 (D), below 60 (E). These cutoffs represent grade minimums. We may adjust grades upward based on class grade distribution curve.

Regrade Policy: If you believe an error has been made in the grading of your exam, you may resubmit it for a regrade - submit a detailed explanation of which problems you think we marked incorrectly and why. Because we will examine your entire submission in detail, your grade can go up or down as a result of a regrade request.

Drop or Withdraw: detailed OSU policy and instructions here

Resources
  • Piazza (QA, discussion, and announcements)
  • Carmen (project submission and restricted resources)
  • Academic Integrity
    Any assignment or exam that you hand in must be your own work (with the exception of group projects). However, talking with others to better understand the material is strongly encouraged. Copying a solution or letting someone copy your solution is cheating. Everything you hand in must be your own words. Code you hand in must be written by you, with the exception of any code provided as part of the assignment. MOSS (Measure of Software Similarity) will be used routinely to detect plagiarism on programming assignments. Any collaboration during an exam is considered cheating. Any student who is caught cheating will be reported to the Committee on Academic Misconduct. Please don't take a chance - if you are having trouble understanding the material, let us know (asking on Piazza, in class or during office hours), and we will be happy to help.
    Programming Projects
    Homework Assignments (subject to change as the autumn 2018 term progresses.)
  • new Homework 0 - Math and Python Review (due 8/29)
  • Homework 1 - Search Review (due TBA)
  • Homework 2 - Markov Decision Processes (due TBA)
  • Homework 3 - Reinforcement Learning: Q-learning (due TBA)
  • Homework 4 - Reinforcement Learning: Feature-based Representations (due TBA)
  • Homework 5 - Probability Review (due TBA)
  • Homework 6 - Hidden Markov Models (due TBA)
  • Homework 7 - Bayes Nets (due TBA)
  • Homework 8 - Naive Bayes (due TBA)

  • Interactive Practice - Alpha-Beta Pruning
  • Example Exam - MDPs, Reinforcement Learning, Markov Model, HMM, Bayes Nets
  • Anonymous Feedback
    Schedule (subject to change as the autumn 2018 term progresses.)
    Date Topic Required Reading Suggested Reading
    8/22 new Course Overview, Reinforcement Learning in NLP Research (Guest Lecture) 3.1-3.4 Microsoft Ms. PacMan
    TBD Search Review 3.5, 3.6 Pancake Sorting
    TBD Game Playing 1 - Minimax 5.1, 5.2, 5.3, 5.4 How Checkers was Solved
    TBD Game Playing 2 - Expectimax and Utilities 5.5, 13.1, 13.2, 16.1, 16.2, 16.3 Rosen's note on Alpha Beta Pruning
    Reinforcement Learning
    TBD Reinforcement Learning 1 - Markov Decision Processes 17.1, 17.2
    TBD Reinforcement Learning 2 - Value Iteration and Policy Iteration 17.3 Real-life examples of Markov Decision Processes
    TBD Reinforcement Learning 3 - Temporal Difference Learning 21.1, 21.2, 21.3 Google AlphaGo
    TBD Reinforcement Learning 4 - Q-Learning 21.1, 21.2, 21.3
    TBD Reinforcement Learning 5 - Function Approximation 21.4 Sutten & Barto's new reinforcement learning book (Ch. 5, 6, 13)
    TBD Reinforcement Learning 6 - Policy Gradient Methods 21.5, 21.6 Deep Q-Learning
    Reasoning Under Uncertainty
    TBD Probability Review 13.3, 13.4, 13.5, 13.6 Andrew Moore's tutorial and Jean Walrand's note on Probability
    TBD Markov Models 15.1, 15.2
    TBD Midterm Review, Graphical Models in NLP Research (Guest Lecture)
    10/10 Midterm (In class - close book and notes)
    TBD Hidden Markov Models 1 - Monitoring and robot localization 15.1, 15.2
    TBD Hidden Markov Models 2 - Particle filtering and resampling 15.3, 15.5
    TBD Bayes Nets 1 - Probabilistic Representations 14.1, 14.2
    TBD Bayes Nets 2 - D-Seperation 14.1, 14.2 Olivier Chapelle's talk on Bayesian Network Click Model for Web Search
    TBD Bayes Nets 3 - Inference 14.4 David Blei's talk on Topic Models and User Behavior
    TBD Bayes Nets 4 - Sampling 14.5
    Machine Learning and Special Topics
    TBD Perceptron and Naive Bayes 18.6
    TBD Computer Vision 1 - Applications and CNNs Facebook Accessibility
    TBD Computer Vision 2 - Deep Neural Networks and Visualization 20.1, 20.2.1, 20.2.2 Google DeepDream
    TBD Final Review, Neural Networks in NLP Research (Guest Lecture) Machine Translation class and book
    TBD Robotics Research
    TBD Final Exam (close book and notes)