Optimal Control with Adversarial Events
školitel: | Doc. Dipl. Ing. Stefan Ratschan, Dr. Tech. |
e-mail: | zobrazit e-mail |
typ práce: | dizertační práce |
zaměření: | MI_MM, MI_AMSM, MINF |
odkaz: | http://www2.cs.cas.cz/~ratschan/ |
popis: | Assume an ordinary differential equation with inputs. Classical optimal control is the problem of finding inputs such that resulting solution of the differential equation optimizes a given objective function. The thesis will study an extension of this problem where some random events beyond our control can influence the differential equation, and the goal is to optimize the expected value of the objective function. This amounts to optimal control for a certain class of stochastic hybrid dynamical systems [1].
The goal of this thesis topic will be the design of an algorithm for solving this problem that can efficiently solve benchmark problems of a size that goes beyond the capabilities of current methods. Suggested basic ingredients will be: - Multiple shooting: a method that can solve highly non-trivial classical optimal control problems [2], but creates inputs that are not able to react to external events. - Approximate dynamic programming [3]: a method that efficiently solves the optimal control problem for Markov decision processes, which corresponds to the given problem, but without the presence of differential equations. |
literatura: | [1] Christos G. Cassandras, John Lygeros: Stochastic Hybrid Systems, CRC Press, 2006
[2] John T. Betts: Practical Methods for Optimal Control and Estimation Using Nonlinear Programming, SIAM, 2010 [3] Warren B. Powell: Approximate Dynamic Programming, Wiley, 2011 |
naposledy změněno: | 27.04.2018 11:42:34 |
za obsah této stránky zodpovídá:
Ľubomíra Dvořáková | naposledy změněno: 12.9.2011