• DocumentCode
    1348632
  • Title

    Mixed risk-neutral/minimax control of discrete-time, finite-state Markov decision processes

  • Author

    Coraluppi, Stefano P. ; Marcus, Steven I.

  • Author_Institution
    Alphatech Inc., Burlington, MA, USA
  • Volume
    45
  • Issue
    3
  • fYear
    2000
  • fDate
    3/1/2000 12:00:00 AM
  • Firstpage
    528
  • Lastpage
    532
  • Abstract
    Addresses the control design problem for discrete-time, finite-state Markov decision processes, when both risk-neutral and minimax objectives are of interest. We introduce the mixed risk-neutral/minimax objective and utilize results from risk-neutral and minimax control to derive an information state process and dynamic programming equations for the value function. We synthesize optimal control laws both on the finite and the infinite horizons. We study the effectiveness of both the mixed risk-neutral/minimax family and the risk-sensitive family of controllers as tools to tradeoff risk-neutral and minimax objectives. We conclude that the mixed risk-neutral/minimax family is more effective, at the cost of increased controller complexity
  • Keywords
    Markov processes; control system synthesis; decision theory; discrete time systems; dynamic programming; optimal control; control design problem; controller complexity; discrete-time finite-state Markov decision processes; finite horizon; infinite horizon; information state process; mixed risk-neutral/minimax control; value function; Control design; Control systems; Cost function; Dynamic programming; Equations; Infinite horizon; Linear systems; Minimax techniques; Optimal control; Robust control;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/9.847737
  • Filename
    847737