Stochastic Optimization

Dit vak wordt in het Engels aangeboden. Omschrijvingen kunnen daardoor mogelijk alleen in het Engels worden weergegeven.

Doel vak

After completing this course, the student can
1. understand the applicability and the limitations of discrete- and
continuous-time Markov decision processes
2. can model real-world decision problems into the Markov decision
theoretic framework
3. can implement decision models to calculate the optimal decision rules
4. can mathematically prove properties of the optimal decision rules in
specific systems
5. can deal with modeling and implementation issues related to the curse
of dimensionality
6. can model problems with partial observations

Inhoud vak

This course deals with the theory and algorithms for stochastic
optimization with an application to controlled stochastic systems (e.g.,
call center management, inventory control, optimal design of
communication networks). We discuss aspects of semi-Markov decision
theory and their applications in certain queueing systems. In a
programming assignment, students learn to implement optimization
algorithms and experiment with them. Experience with and insight into
the more theoretical subject is obtained through homework exercises.​




Programming and written exercises, final exam.
Assignments: 30%
Exam: 70%

The weighted average needs to be 5.5 or higher.

Vereiste voorkennis

Programming experience in any language


Lecture notes will be posted on Canvas.


mBA, mBa-D, mMath, mSFM.

Aanbevolen voorkennis

Stochastic Modeling (X_400646) or equivalent courses on Stochastic
Processes and Queueing Theory.

Algemene informatie

Vakcode X_400336
Studiepunten 6 EC
Periode P1+2
Vakniveau 400
Onderwijstaal Engels
Faculteit Faculteit der Bètawetenschappen
Vakcoördinator prof. dr. G.M. Koole
Examinator prof. dr. G.M. Koole
Docenten prof. dr. G.M. Koole

Praktische informatie

Voor dit vak moet je zelf intekenen.

Voor dit vak kun je last-minute intekenen.

Werkvormen Hoorcollege

Dit vak is ook toegankelijk als: