• DocumentCode
    1355160
  • Title

    A risk-sensitive maximum principle: the case of imperfect state observation

  • Author

    Whittle, Peter

  • Author_Institution
    Stat. Lab., Cambridge Univ., UK
  • Volume
    36
  • Issue
    7
  • fYear
    1991
  • fDate
    7/1/1991 12:00:00 AM
  • Firstpage
    793
  • Lastpage
    801
  • Abstract
    The risk-sensitive maximum principle for optimal stochastic control derived by the author in an earlier work (System Control Letters, vol.15, 1990) is restated. This is an immediate generalization of the classic Pontryagin principle, to which it reduces in the deterministic case, and is expressed immediately in terms of observables. It is derived on the assumption that the criterion function is the exponential of an additive cost function, and is exact under linear-quadratic Gaussian assumptions, but is otherwise valid as a large deviation approximation. The principle is extended to the case of imperfect state observation after preliminary establishment of a certainty-equivalence principle. The derivation yields as byproduct a large-deviation version of the updating equation for nonlinear filtering. The development is heuristic. It is believed that the mathematical arguments given are the essential ones, and provide a self-contained treatment at this level
  • Keywords
    maximum principle; optimal control; optimisation; Pontryagin principle; additive cost function; certainty-equivalence principle; imperfect state observation; linear-quadratic Gaussian assumptions; maximum principle; nonlinear filtering; optimal control; optimal stochastic control; Computer aided software engineering; Cost function; Councils; Filtering; Nonlinear equations; Optimal control; Process control; Stochastic processes;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/9.85059
  • Filename
    85059