DocumentCode :
1348632
Title :
Mixed risk-neutral/minimax control of discrete-time, finite-state Markov decision processes
Author :
Coraluppi, Stefano P. ; Marcus, Steven I.
Author_Institution :
Alphatech Inc., Burlington, MA, USA
Volume :
45
Issue :
3
fYear :
2000
fDate :
3/1/2000 12:00:00 AM
Firstpage :
528
Lastpage :
532
Abstract :
Addresses the control design problem for discrete-time, finite-state Markov decision processes, when both risk-neutral and minimax objectives are of interest. We introduce the mixed risk-neutral/minimax objective and utilize results from risk-neutral and minimax control to derive an information state process and dynamic programming equations for the value function. We synthesize optimal control laws both on the finite and the infinite horizons. We study the effectiveness of both the mixed risk-neutral/minimax family and the risk-sensitive family of controllers as tools to tradeoff risk-neutral and minimax objectives. We conclude that the mixed risk-neutral/minimax family is more effective, at the cost of increased controller complexity
Keywords :
Markov processes; control system synthesis; decision theory; discrete time systems; dynamic programming; optimal control; control design problem; controller complexity; discrete-time finite-state Markov decision processes; finite horizon; infinite horizon; information state process; mixed risk-neutral/minimax control; value function; Control design; Control systems; Cost function; Dynamic programming; Equations; Infinite horizon; Linear systems; Minimax techniques; Optimal control; Robust control;
fLanguage :
English
Journal_Title :
Automatic Control, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9286
Type :
jour
DOI :
10.1109/9.847737
Filename :
847737
Link To Document :
بازگشت