• DocumentCode
    3478825
  • Title

    Percentile objective criteria in limiting average Markov control problems

  • Author

    Filar, Jerzy A. ; Krass, Dmitry ; Ross, Keith W.

  • Author_Institution
    Dept. of Math. & Stat., Maryland Univ., Baltimore, MD, USA
  • fYear
    1989
  • fDate
    13-15 Dec 1989
  • Firstpage
    1273
  • Abstract
    The point of view is adopted that there are many natural situations in which the controller is interested in finding a policy that will achieve a sufficiently high long-run average reward, that is, a target level with a sufficiently high probability, that is, a percentile. The key conceptual difference between this approach and the classical problem is that the present controller is not searching for an optimal policy but rather for a policy that is `good enough´, knowing that such a policy will typically fail to exist if the target level and the percentile are set too high. Conceptually, the approach is somewhat analogous to that often adopted by statisticians in testing of hypotheses where it is desirable (but usually not possible) to minimize simultaneously the so-called `type 1´ and the `type 2´ errors
  • Keywords
    Markov processes; decision theory; probability; Markov control problems; Markov decision processes; percentile objective criteria; probability; target level; Control systems; Frequency; Infinite horizon; Optimal control; Random variables; State-space methods; Statistics; Testing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control, 1989., Proceedings of the 28th IEEE Conference on
  • Conference_Location
    Tampa, FL
  • Type

    conf

  • DOI
    10.1109/CDC.1989.70342
  • Filename
    70342