Title :
Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes
Author_Institution :
Zhongshan Univ., Guangzhou
fDate :
6/1/2007 12:00:00 AM
Abstract :
To the best of our knowledge, this note is a first study on a multiconstrained optimization problem for average cost continuous-time Markov decision processes in polish spaces. The optimality criterion is the long-run expected average cost, and the constraints are imposed on similar average costs. We give suitable conditions under which the existence of a constrained optimal stationary policy is shown by introducing occupation measures and using a martingale technique. Also, we illustrate our conditions with controlled Potlach processes.
Keywords :
Markov processes; continuous time systems; optimal control; optimisation; Potlach processes; constrained optimal stationary policy; constrained optimization; continuous-time Markov decision processes; long-run expected average cost; multiconstrained optimization problem; optimality criterion; Communication system control; Constraint optimization; Constraint theory; Control system synthesis; Cost function; Optimal control; Process control; State-space methods; Stochastic processes; Systems engineering and theory; Average cost; constrained optimal stationary policy; general state space; martingale; occupation measure;
Journal_Title :
Automatic Control, IEEE Transactions on
DOI :
10.1109/TAC.2007.899040