DocumentCode :
1355160
Title :
A risk-sensitive maximum principle: the case of imperfect state observation
Author :
Whittle, Peter
Author_Institution :
Stat. Lab., Cambridge Univ., UK
Volume :
36
Issue :
7
fYear :
1991
fDate :
7/1/1991 12:00:00 AM
Firstpage :
793
Lastpage :
801
Abstract :
The risk-sensitive maximum principle for optimal stochastic control derived by the author in an earlier work (System Control Letters, vol.15, 1990) is restated. This is an immediate generalization of the classic Pontryagin principle, to which it reduces in the deterministic case, and is expressed immediately in terms of observables. It is derived on the assumption that the criterion function is the exponential of an additive cost function, and is exact under linear-quadratic Gaussian assumptions, but is otherwise valid as a large deviation approximation. The principle is extended to the case of imperfect state observation after preliminary establishment of a certainty-equivalence principle. The derivation yields as byproduct a large-deviation version of the updating equation for nonlinear filtering. The development is heuristic. It is believed that the mathematical arguments given are the essential ones, and provide a self-contained treatment at this level
Keywords :
maximum principle; optimal control; optimisation; Pontryagin principle; additive cost function; certainty-equivalence principle; imperfect state observation; linear-quadratic Gaussian assumptions; maximum principle; nonlinear filtering; optimal control; optimal stochastic control; Computer aided software engineering; Cost function; Councils; Filtering; Nonlinear equations; Optimal control; Process control; Stochastic processes;
fLanguage :
English
Journal_Title :
Automatic Control, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9286
Type :
jour
DOI :
10.1109/9.85059
Filename :
85059
Link To Document :
بازگشت