DocumentCode
1348632
Title
Mixed risk-neutral/minimax control of discrete-time, finite-state Markov decision processes
Author
Coraluppi, Stefano P. ; Marcus, Steven I.
Author_Institution
Alphatech Inc., Burlington, MA, USA
Volume
45
Issue
3
fYear
2000
fDate
3/1/2000 12:00:00 AM
Firstpage
528
Lastpage
532
Abstract
Addresses the control design problem for discrete-time, finite-state Markov decision processes, when both risk-neutral and minimax objectives are of interest. We introduce the mixed risk-neutral/minimax objective and utilize results from risk-neutral and minimax control to derive an information state process and dynamic programming equations for the value function. We synthesize optimal control laws both on the finite and the infinite horizons. We study the effectiveness of both the mixed risk-neutral/minimax family and the risk-sensitive family of controllers as tools to tradeoff risk-neutral and minimax objectives. We conclude that the mixed risk-neutral/minimax family is more effective, at the cost of increased controller complexity
Keywords
Markov processes; control system synthesis; decision theory; discrete time systems; dynamic programming; optimal control; control design problem; controller complexity; discrete-time finite-state Markov decision processes; finite horizon; infinite horizon; information state process; mixed risk-neutral/minimax control; value function; Control design; Control systems; Cost function; Dynamic programming; Equations; Infinite horizon; Linear systems; Minimax techniques; Optimal control; Robust control;
fLanguage
English
Journal_Title
Automatic Control, IEEE Transactions on
Publisher
ieee
ISSN
0018-9286
Type
jour
DOI
10.1109/9.847737
Filename
847737
Link To Document