DocumentCode
3478825
Title
Percentile objective criteria in limiting average Markov control problems
Author
Filar, Jerzy A. ; Krass, Dmitry ; Ross, Keith W.
Author_Institution
Dept. of Math. & Stat., Maryland Univ., Baltimore, MD, USA
fYear
1989
fDate
13-15 Dec 1989
Firstpage
1273
Abstract
The point of view is adopted that there are many natural situations in which the controller is interested in finding a policy that will achieve a sufficiently high long-run average reward, that is, a target level with a sufficiently high probability, that is, a percentile. The key conceptual difference between this approach and the classical problem is that the present controller is not searching for an optimal policy but rather for a policy that is `good enough´, knowing that such a policy will typically fail to exist if the target level and the percentile are set too high. Conceptually, the approach is somewhat analogous to that often adopted by statisticians in testing of hypotheses where it is desirable (but usually not possible) to minimize simultaneously the so-called `type 1´ and the `type 2´ errors
Keywords
Markov processes; decision theory; probability; Markov control problems; Markov decision processes; percentile objective criteria; probability; target level; Control systems; Frequency; Infinite horizon; Optimal control; Random variables; State-space methods; Statistics; Testing;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control, 1989., Proceedings of the 28th IEEE Conference on
Conference_Location
Tampa, FL
Type
conf
DOI
10.1109/CDC.1989.70342
Filename
70342
Link To Document