DocumentCode
3082146
Title
Value iteration and rolling plans for Markov control processes with unbounded rewards
Author
Hernández-Lerma, Onésimo ; Lasserre, Jean B.
Author_Institution
CINVESTAV-IPN, Mexico City, Mexico
fYear
1990
fDate
5-7 Dec 1990
Firstpage
1381
Abstract
The authors study the convergence of value-iteration functions and the existence of error bounds for rolling horizon procedures in discrete-time Markov control processes with Borel state and control spaces, and unbounded reward functions with a discount factor. As expected, in contrast to the bounded case, the bounds are `pointwise,´ not `uniform´. In addition, it is shown how the error bound in the weighted norm case can be improved by introducing appropriate ergodicity conditions
Keywords
Markov processes; convergence of numerical methods; iterative methods; stochastic systems; Borel control space; Borel state space; discount factor; discrete-time Markov control processes; ergodicity conditions; error bounds; pointwise bounds; rolling horizon procedures; rolling plans; unbounded reward functions; unbounded rewards; value-iteration functions; weighted norm; Control system synthesis; Control systems; Convergence; Dynamic programming; Error correction; Infinite horizon; Optimal control; Process control; Production control; Stochastic processes;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control, 1990., Proceedings of the 29th IEEE Conference on
Conference_Location
Honolulu, HI
Type
conf
DOI
10.1109/CDC.1990.203835
Filename
203835
Link To Document