Title :
Value iteration and rolling plans for Markov control processes with unbounded rewards
Author :
Hernández-Lerma, Onésimo ; Lasserre, Jean B.
Author_Institution :
CINVESTAV-IPN, Mexico City, Mexico
Abstract :
The authors study the convergence of value-iteration functions and the existence of error bounds for rolling horizon procedures in discrete-time Markov control processes with Borel state and control spaces, and unbounded reward functions with a discount factor. As expected, in contrast to the bounded case, the bounds are `pointwise,´ not `uniform´. In addition, it is shown how the error bound in the weighted norm case can be improved by introducing appropriate ergodicity conditions
Keywords :
Markov processes; convergence of numerical methods; iterative methods; stochastic systems; Borel control space; Borel state space; discount factor; discrete-time Markov control processes; ergodicity conditions; error bounds; pointwise bounds; rolling horizon procedures; rolling plans; unbounded reward functions; unbounded rewards; value-iteration functions; weighted norm; Control system synthesis; Control systems; Convergence; Dynamic programming; Error correction; Infinite horizon; Optimal control; Process control; Production control; Stochastic processes;
Conference_Titel :
Decision and Control, 1990., Proceedings of the 29th IEEE Conference on
Conference_Location :
Honolulu, HI
DOI :
10.1109/CDC.1990.203835