DocumentCode :
995946
Title :
A new risk-sensitive maximum principle
Author :
Lim, Andrew E B ; Zhou, Xun Yu
Author_Institution :
Dept. of Ind. Eng. & Oper.s Res., Univ. of California, Berkeley, CA, USA
Volume :
50
Issue :
7
fYear :
2005
fDate :
7/1/2005 12:00:00 AM
Firstpage :
958
Lastpage :
966
Abstract :
In this paper, a new maximum principle for the risk-sensitive control problem is established. One important feature of this result is that it applies to systems in which the diffusion term may depend on the control. Such control dependence gives rise to interesting phenomena not observed in the usual setting where control independence of the diffusion term is assumed. In particular, there is an additional second order adjoint equation and additional terms in the maximum condition that involve this second order process as well as the risk-sensitive parameter. Moreover, contrary to a conventional maximum principle, the first-order adjoint equation involved in our maximum principle is a nonlinear equation. An advantage of considering this new type of adjoint equation is that the risk-sensitive maximum principle derived is similar in form to its risk-neutral counterpart. The approach is based on the logarithmic transformation and the relationship between the adjoint variables and the value function. As an example, a linear-quadratic risk-sensitive problem is solved using the maximum principle derived.
Keywords :
linear quadratic control; maximum principle; nonlinear equations; adjoint variables; control independence; control problem; diffusion term; linear-quadratic risk-sensitive problem; logarithmic transformation; nonlinear equation; risk-sensitive control; risk-sensitive maximum principle; second order adjoint equation; second order process; value function; Control systems; Cost function; Differential equations; Diffusion processes; Nonlinear equations; Optimal control; Process control; Stochastic processes; Stochastic systems; Weight control; Adjoint equations; backward stochastic differential equations; logarithmic transformation; maximum principle; risk-sensitive control;
fLanguage :
English
Journal_Title :
Automatic Control, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9286
Type :
jour
DOI :
10.1109/TAC.2005.851441
Filename :
1463303
Link To Document :
بازگشت