Reinforcement Learning 2014/2015

Lectures will be held between 12:10 - 13:00 in AT LT2 on Tuesdays and 12:10 - 13:00 same place on Fridays.
Basic Mathematical Background: Please review this cribsheet to make sure you understand the concepts therein. You may also find these resources useful as occasional reference material.
On Using Matlab: Take a look at this handout Introduction to MATLAB giving an introduction to MATLAB (you may ignore the section about NETLAB). A further MATLAB tutorial is available at MTU Introduction to Matlab.

Date:
Lecture topic (may change until link to slides is present):
January 13 2015
Introduction
Slides (pdf)
Reading: Ch 1 of Sutton & Barto book
January 16 2015
Multi-Armed Bandits
Slides (pdf)
Reading: Ch 2 of Sutton & Barto book
January 20 2015
Q-learning I
Slides (pdf)
Reading: see last slide
January 23 2015
Q-learning II
Slides (pdf)
Reading: See slides 14 and 15 for suggestions
January 27 2015
More RL algorithms
Slides (pdf)
Reading: Ch 6.4 and 11.2 of Sutton and Barto (2)
January 30 2015
Value functions and the Bellman equation, value prediction
Reading: Ch 2.1 of Szepesvari book
February 3 2015
Reinforcement learning: Eligibility traces
Reading: see slides for reading suggestions
February 5 2015
Homework 1 assigned
February 6 2015
Value iteration and policy iteration
Reading: see slides for reading suggestions
February 10 2015
RL Algorithms and State Abstraction
Literature on last slide.
February 13 2015
Hierarchical RL

February 24 2015
POMDPs
Literature on last slide.
February 26 2015
Homework 1 due (Deadline: 16:00)
February 27 2015
POMDPs continued
Literature on last slide.
March 3 2015
RL with Function Approximation
Based on C. Szepesvari: Algorithms for RL, Chapter 2.2
March 5 2015
Homework 2 assigned
March 6 2015
Policy gradient methods, natural actor-critic)
March 10 2015
Complexity of RL

March 13 2015
Complexity and convergence
March 17 2015
Apprenticeship learning and inverse RL
March 20 2015
A unfied view and recent trends (not examinable, JFYI)
March 24 2015
Bonus lecture (not examinable, JFYI)
March 26 2015
Homework 2 due (Deadline: 16:00)
March 27 2015
Bonus lecture (not examinable, JFYI)

Tutorials

The course includes 8 tutorials. Tutorials will start in week 3. Please contact the lecturer if you are not assigned to any group by week 2.

RL Home


Home : Teaching : Courses : Rl 

Informatics Forum, 10 Crichton Street, Edinburgh, EH8 9AB, Scotland, UK
Tel: +44 131 651 5661, Fax: +44 131 651 1426, E-mail: school-office@inf.ed.ac.uk
Please contact our webadmin with any comments or corrections. Logging and Cookies
Unless explicitly stated otherwise, all material is copyright © The University of Edinburgh