Title :
Finite horizon semi-Markov decision processes with multiple constraints
Author_Institution :
Sch. of Math. & Comput. Sci., Sun Yat-Sen Univ., Guangzhou, China
Abstract :
This paper focuses on solving a finite horizon semi-Markov decision process with multiple constraints. We convert the problem to a constrained absorbing discrete-time Markov decision process and then to an equivalent linear program over a class of occupancy measures. The existence, characterization and computation of constrained-optimal policies are established under suitable conditions. An example is given to demonstrate our results.
Keywords :
Markov processes; constraint theory; decision theory; linear programming; constrained absorbing discrete-time Markov decision process; finite horizon semiMarkov decision processes; linear program; multiple constraints; occupancy measures; Markov processes; Semi-Markov decision processes; constrained-optimal policy; expected finite horizon reward; linear programm; occupancy measure;
Conference_Titel :
Intelligent Control and Automation (WCICA), 2014 11th World Congress on
DOI :
10.1109/WCICA.2014.7052987