DocumentCode :
424656
Title :
A note on some new results on the ergodic control of partially observed Markov chains
Author :
Hsu, Shun-Pin ; Arapostathis, Ari
Author_Institution :
Dept. of Electr. Eng., National Chi-Nan Univ., Nantou, Taiwan
Volume :
1
fYear :
2004
fDate :
June 30 2004-July 2 2004
Firstpage :
708
Abstract :
In an early paper (Chuang, D. M. and Arapostathis, A., 1999), the ergodic control problem of partially observed Markov chains was studied. A major assumption was proposed to justify the existence of the optimal policy characterized by a dynamic programming equation. In this note we show that the major assumption, though quite general and easily verifiable, is not satisfied by an important class of machine maintenance problems. A modified version of the assumption is thus presented to improve this shortage and an example is analyzed to show our work.
Keywords :
Markov processes; dynamic programming; stochastic systems; dynamic programming equation; ergodic control; machine maintenance problems; partially observed Markov chains;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
American Control Conference, 2004. Proceedings of the 2004
Conference_Location :
Boston, MA, USA
ISSN :
0743-1619
Print_ISBN :
0-7803-8335-4
Type :
conf
Filename :
1383687
Link To Document :
بازگشت