• Title of article

    A weakly monotonic backward induction algorithm on finite bounded subsets of vector lattices

  • Author/Authors

    Dragut، نويسنده , , A.B، نويسنده ,

  • Issue Information
    روزنامه با شماره پیاپی سال 2004
  • Pages
    12
  • From page
    295
  • To page
    306
  • Abstract
    We present a new efficient and robust backward induction algorithm, which is weakly monotonic, working on bounded subsets without holes of lattices. We prove all its properties, give examples of applications, and illustrate its behavior, comparing it with the natural extension of the unidimensional algorithm presented in Puterman (Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, New York, 1994), in the sense of Topkis (Frontiers of Economic Research Series, Princeton University Press, Princeton, NJ, 1998) and White (Recent Developments in Markov Decision Processes, Academic Press, New York, 1980, 261) and showing, also experimentally, that it is much more efficient.
  • Keywords
    Discrete-time controlled dynamical systems , Nonstationary Markov decision processes , partial order , Nonchaotic weakly monotonic optimal policies
  • Journal title
    Journal of Computational and Applied Mathematics
  • Serial Year
    2004
  • Journal title
    Journal of Computational and Applied Mathematics
  • Record number

    1552479