2.997 Decision Making in Large Scale Systems

Spring 2004

Diagram of the game Tetris.
Tetris game strategies can be analyzed using the value function approximation techniques described in this course -- see lecture session 10.  (Illustration courtesy of OCW.)

Course Highlights

This course features extensive lecture notes and readings, plus selected examples of student projects.

Course Description

This course is an introduction to the theory and application of large-scale dynamic programming. Topics include Markov decision processes, dynamic programming algorithms, simulation-based algorithms, theory and algorithms for value function approximation, and policy search methods. The course examines games and applications in areas such as dynamic resource allocation, finance and queueing networks.

Technical Requirements

Postscript viewer software, such as  Ghostscript/Ghostview, can be used to view the .ps files found on this course site.

Donate Now


Prof. Daniela Pucci De Farias

Course Meeting Times

Two sessions / week
1.5 hours / session