DocumentCode :
3766034
Title :
Finite-state approximations to constrained Markov decision processes with Borel spaces
Author :
Naci Saldi;Serdar Yüksel;Tamás Linder
Author_Institution :
Department of Mathematics and Statistics, Queen´s University, Kingston, ON, Canada
fYear :
2015
Firstpage :
567
Lastpage :
572
Abstract :
We consider the finite-state approximation of a discrete-time constrained Markov decision process with compact state space, under the discounted cost criterion. Using the linear programming formulation of the constrained problem, we prove the convergence of the optimal value function of the finite-state model to the optimal value function of the original model. Under further continuity condition on the transition probability of the original model, we also establish a method to compute approximately optimal policies.
Keywords :
"Markov processes","Cost function","Mathematical model","Kernel","Dynamic programming","Extraterrestrial measurements"
Publisher :
ieee
Conference_Titel :
Communication, Control, and Computing (Allerton), 2015 53rd Annual Allerton Conference on
Type :
conf
DOI :
10.1109/ALLERTON.2015.7447055
Filename :
7447055
Link To Document :
بازگشت