DocumentCode :
2575507
Title :
Singular perturbation for the discounted continuous control of piecewise deterministic Markov processes
Author :
Costa, O.L.V. ; Dufour, F.
Author_Institution :
Dept. de Eng. de Telecomun. e Controle, Escola Politec. da Univ. de Sao Paulo, São Paulo, Brazil
fYear :
2010
fDate :
15-17 Dec. 2010
Firstpage :
1436
Lastpage :
1441
Abstract :
This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP´s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of an averaged model in which the regimes within the same class are aggregated through a quasi-stationary distribution. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.
Keywords :
Markov processes; convergence; optimal control; piecewise constant techniques; singularly perturbed systems; Lipschitz continuity condition; discounted continuous control; optimality inequality; perturbed Markov chain; piecewise deterministic Markov process; quasistationary distribution; singular perturbation; uniqueness argument; value function; Aerospace electronics; Kernel; Markov processes; Measurement; Optimization; Process control; Topology;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Decision and Control (CDC), 2010 49th IEEE Conference on
Conference_Location :
Atlanta, GA
ISSN :
0743-1546
Print_ISBN :
978-1-4244-7745-6
Type :
conf
DOI :
10.1109/CDC.2010.5717626
Filename :
5717626
Link To Document :
بازگشت