DocumentCode
1355160
Title
A risk-sensitive maximum principle: the case of imperfect state observation
Author
Whittle, Peter
Author_Institution
Stat. Lab., Cambridge Univ., UK
Volume
36
Issue
7
fYear
1991
fDate
7/1/1991 12:00:00 AM
Firstpage
793
Lastpage
801
Abstract
The risk-sensitive maximum principle for optimal stochastic control derived by the author in an earlier work (System Control Letters, vol.15, 1990) is restated. This is an immediate generalization of the classic Pontryagin principle, to which it reduces in the deterministic case, and is expressed immediately in terms of observables. It is derived on the assumption that the criterion function is the exponential of an additive cost function, and is exact under linear-quadratic Gaussian assumptions, but is otherwise valid as a large deviation approximation. The principle is extended to the case of imperfect state observation after preliminary establishment of a certainty-equivalence principle. The derivation yields as byproduct a large-deviation version of the updating equation for nonlinear filtering. The development is heuristic. It is believed that the mathematical arguments given are the essential ones, and provide a self-contained treatment at this level
Keywords
maximum principle; optimal control; optimisation; Pontryagin principle; additive cost function; certainty-equivalence principle; imperfect state observation; linear-quadratic Gaussian assumptions; maximum principle; nonlinear filtering; optimal control; optimal stochastic control; Computer aided software engineering; Cost function; Councils; Filtering; Nonlinear equations; Optimal control; Process control; Stochastic processes;
fLanguage
English
Journal_Title
Automatic Control, IEEE Transactions on
Publisher
ieee
ISSN
0018-9286
Type
jour
DOI
10.1109/9.85059
Filename
85059
Link To Document