DocumentCode
424656
Title
A note on some new results on the ergodic control of partially observed Markov chains
Author
Hsu, Shun-Pin ; Arapostathis, Ari
Author_Institution
Dept. of Electr. Eng., National Chi-Nan Univ., Nantou, Taiwan
Volume
1
fYear
2004
fDate
June 30 2004-July 2 2004
Firstpage
708
Abstract
In an early paper (Chuang, D. M. and Arapostathis, A., 1999), the ergodic control problem of partially observed Markov chains was studied. A major assumption was proposed to justify the existence of the optimal policy characterized by a dynamic programming equation. In this note we show that the major assumption, though quite general and easily verifiable, is not satisfied by an important class of machine maintenance problems. A modified version of the assumption is thus presented to improve this shortage and an example is analyzed to show our work.
Keywords
Markov processes; dynamic programming; stochastic systems; dynamic programming equation; ergodic control; machine maintenance problems; partially observed Markov chains;
fLanguage
English
Publisher
ieee
Conference_Titel
American Control Conference, 2004. Proceedings of the 2004
Conference_Location
Boston, MA, USA
ISSN
0743-1619
Print_ISBN
0-7803-8335-4
Type
conf
Filename
1383687
Link To Document