Title :
Dynamic programming with non-convex risk-sensitive measures
Author :
Kun Lin ; Marcus, Steven I.
Author_Institution :
Dept. of Electr. & Comput. Eng., Inst. for Syst. Res., Univ. of Maryland, College Park, MD, USA
Abstract :
Dynamic programming with risk-sensitive performance criteria has applications in many fields (e.g., operations research, finance, control systems). Historically, risk-sensitive performance criteria have been represented using expected utility functions. More recently, literature on dynamic performance (i.e., risk or reward) measures has inspired an alternative approach to risk-sensitive performance evaluation. The dynamic performance measure approach is a generalization of the classical work using expected value. One drawback of this approach is that it has only been developed with convex/coherent performance measures, which exclude a large class of important non-convex performance criteria (e.g., Cumulative Prospect Theory (CPT)). We remedy this drawback by proving the existence of dynamic programming equations for non-convex performance criteria.
Keywords :
concave programming; dynamic programming; risk management; utility theory; CPT; coherent performance measures; convex performance measures; cumulative prospect theory; dynamic programming equations; expected utility functions; nonconvex risk-sensitive measures; risk-sensitive performance criteria; risk-sensitive performance evaluation; Aerospace electronics; Current measurement; Dynamic programming; Equations; Markov processes; Mathematical model; Random variables; Dynamic Programming; Markov Decision Processes (MDP); Non-Convex; Risk-Sensitive;
Conference_Titel :
American Control Conference (ACC), 2013
Conference_Location :
Washington, DC
Print_ISBN :
978-1-4799-0177-7
DOI :
10.1109/ACC.2013.6580904