• DocumentCode
    424656
  • Title

    A note on some new results on the ergodic control of partially observed Markov chains

  • Author

    Hsu, Shun-Pin ; Arapostathis, Ari

  • Author_Institution
    Dept. of Electr. Eng., National Chi-Nan Univ., Nantou, Taiwan
  • Volume
    1
  • fYear
    2004
  • fDate
    June 30 2004-July 2 2004
  • Firstpage
    708
  • Abstract
    In an early paper (Chuang, D. M. and Arapostathis, A., 1999), the ergodic control problem of partially observed Markov chains was studied. A major assumption was proposed to justify the existence of the optimal policy characterized by a dynamic programming equation. In this note we show that the major assumption, though quite general and easily verifiable, is not satisfied by an important class of machine maintenance problems. A modified version of the assumption is thus presented to improve this shortage and an example is analyzed to show our work.
  • Keywords
    Markov processes; dynamic programming; stochastic systems; dynamic programming equation; ergodic control; machine maintenance problems; partially observed Markov chains;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    American Control Conference, 2004. Proceedings of the 2004
  • Conference_Location
    Boston, MA, USA
  • ISSN
    0743-1619
  • Print_ISBN
    0-7803-8335-4
  • Type

    conf

  • Filename
    1383687