• DocumentCode
    995946
  • Title

    A new risk-sensitive maximum principle

  • Author

    Lim, Andrew E B ; Zhou, Xun Yu

  • Author_Institution
    Dept. of Ind. Eng. & Oper.s Res., Univ. of California, Berkeley, CA, USA
  • Volume
    50
  • Issue
    7
  • fYear
    2005
  • fDate
    7/1/2005 12:00:00 AM
  • Firstpage
    958
  • Lastpage
    966
  • Abstract
    In this paper, a new maximum principle for the risk-sensitive control problem is established. One important feature of this result is that it applies to systems in which the diffusion term may depend on the control. Such control dependence gives rise to interesting phenomena not observed in the usual setting where control independence of the diffusion term is assumed. In particular, there is an additional second order adjoint equation and additional terms in the maximum condition that involve this second order process as well as the risk-sensitive parameter. Moreover, contrary to a conventional maximum principle, the first-order adjoint equation involved in our maximum principle is a nonlinear equation. An advantage of considering this new type of adjoint equation is that the risk-sensitive maximum principle derived is similar in form to its risk-neutral counterpart. The approach is based on the logarithmic transformation and the relationship between the adjoint variables and the value function. As an example, a linear-quadratic risk-sensitive problem is solved using the maximum principle derived.
  • Keywords
    linear quadratic control; maximum principle; nonlinear equations; adjoint variables; control independence; control problem; diffusion term; linear-quadratic risk-sensitive problem; logarithmic transformation; nonlinear equation; risk-sensitive control; risk-sensitive maximum principle; second order adjoint equation; second order process; value function; Control systems; Cost function; Differential equations; Diffusion processes; Nonlinear equations; Optimal control; Process control; Stochastic processes; Stochastic systems; Weight control; Adjoint equations; backward stochastic differential equations; logarithmic transformation; maximum principle; risk-sensitive control;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/TAC.2005.851441
  • Filename
    1463303