| CSE 6369 | ||||
| Reinforcement Learning | ||||
| Tentative Lecture and Assignment Schedule | ||||
| Spring Semester 2020 - TTh 3:30 - 4:50 | ||||
| Class | Date | Readings | Lecture Topics | Assignments |
| 1 | 01/21 | 1.1 - 1.6 | Course Overview and Introduction | |
| 2 | 01/23 | Background - Utility and Decision Theory | ||
| 3 | 01/28 | 2.1 - 2-10 | N-Armed Bandit Problems | |
| 4 | 01/30 | 3.1 - 3.8 | Background - Probabilistic models and MDPs | |
| 5 | 02/04 | 4.1 - 4.2, 4.4 | Dynamic Programming Methods - Value Iteration | |
| 6 | 02/06 | 4.3 - 4.8 | Dynamic Programming Methods - Policy Iteration | |
| 7 | 02/11 | 5.1-5.10 | Monte Carlo Methods | Homework 1 due |
| 8 | 02/13 | Temporal Difference Learning | Quiz 1 | |
| 9 | 02/18 | Actor-Critic Models | ||
| 10 | 02/20 | Actor-Critic Models | ||
| 11 | 02/25 | On-Policy vs Off-Policy Learning | ||
| 12 | 02/27 | Function Approximation in Reinforcement Learning | ||
| 13 | 03/03 | Function Approximation in Reinforcement Learning | Project 1 due | |
| 14 | 03/05 | Exploration vs. Exploitation Tradeoff | Quiz 2 | |
| 03/10 | Spring Break - No Class | |||
| 03/12 | Spring Break - No Class | |||
| 15 | 03/17 | Model-Based Learning | ||
| 16 | 03/19 | Learning Models for Reinforcement Learning | ||
| 17 | 03/24 | Learning Models for Reinforcement Learning | Homework 2 due | |
| 18 | 03/26 | Efficient Model-Based Learning | Quiz 3 | |
| 19 | 03/31 | Efficient Model-Based Learning | ||
| 20 | 04/02 | Learning in Partially Observable Systems | ||
| 21 | 04/07 | Learning in Partially Observable Systems | Project 2 due | |
| 22 | 04/09 | Learning in Partially Observable Systems | Quiz 4 | |
| 23 | 04/14 | Hierarchical Reinforcement Learning | ||
| 24 | 04/16 | Hierarchical Reinforcement Learning | ||
| 25 | 04/21 | Hierarchical Reinforcement Learning | Homework 3 due | |
| 26 | 04/23 | Inverse Reinforcement Learning | Quiz 5 | |
| 27 | 04/28 | Reinforcement Learning in Multiagent Domains | ||
| 28 | 04/30 | Deep Reinforcement Learning | ||
| 29 | 05/05 | Deep Reinforcement Learning | Project 3 due | |
| 30 | 05/07 | Deep Reinforcement Learning & Current Challenges | Quiz 6 | |
| 31 | 05/14 | Final Project Presentations (2:00pm-4:30pm) | ||