Title of article
The vanishing discount approach to constrained continuous-time controlled Markov chains
Author/Authors
Prieto-Rumeau، نويسنده , , Tomلs and Hernلndez-Lerma، نويسنده , , Onésimo، نويسنده ,
Issue Information
ماهنامه با شماره پیاپی سال 2010
Pages
6
From page
504
To page
509
Abstract
We consider a denumerable state continuous-time controlled Markov chain (CMC) with possibly unbounded transition and reward rates. We deal with constrained optimality; that is, we want to maximize a discounted reward (an average reward) criterion subject to a constraint on a discounted cost (an average cost). We give conditions ensuring that the average constrained optimal reward and policies can be obtained as the limit, as the discount rate vanishes, of the corresponding discounted constrained optimal reward and policies. This extends to average constrained CMCs the standard results on the vanishing discount approach for the average unconstrained case. We also present an example showing that the vanishing discount results for constrained problems might not hold.
Keywords
Continuous-time controlled Markov chains (CMCs) , Vanishing discount approach , Constrained control models
Journal title
Systems and Control Letters
Serial Year
2010
Journal title
Systems and Control Letters
Record number
1675524
Link To Document