• DocumentCode
    3082146
  • Title

    Value iteration and rolling plans for Markov control processes with unbounded rewards

  • Author

    Hernández-Lerma, Onésimo ; Lasserre, Jean B.

  • Author_Institution
    CINVESTAV-IPN, Mexico City, Mexico
  • fYear
    1990
  • fDate
    5-7 Dec 1990
  • Firstpage
    1381
  • Abstract
    The authors study the convergence of value-iteration functions and the existence of error bounds for rolling horizon procedures in discrete-time Markov control processes with Borel state and control spaces, and unbounded reward functions with a discount factor. As expected, in contrast to the bounded case, the bounds are `pointwise,´ not `uniform´. In addition, it is shown how the error bound in the weighted norm case can be improved by introducing appropriate ergodicity conditions
  • Keywords
    Markov processes; convergence of numerical methods; iterative methods; stochastic systems; Borel control space; Borel state space; discount factor; discrete-time Markov control processes; ergodicity conditions; error bounds; pointwise bounds; rolling horizon procedures; rolling plans; unbounded reward functions; unbounded rewards; value-iteration functions; weighted norm; Control system synthesis; Control systems; Convergence; Dynamic programming; Error correction; Infinite horizon; Optimal control; Process control; Production control; Stochastic processes;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control, 1990., Proceedings of the 29th IEEE Conference on
  • Conference_Location
    Honolulu, HI
  • Type

    conf

  • DOI
    10.1109/CDC.1990.203835
  • Filename
    203835