DocumentCode
2575507
Title
Singular perturbation for the discounted continuous control of piecewise deterministic Markov processes
Author
Costa, O.L.V. ; Dufour, F.
Author_Institution
Dept. de Eng. de Telecomun. e Controle, Escola Politec. da Univ. de Sao Paulo, São Paulo, Brazil
fYear
2010
fDate
15-17 Dec. 2010
Firstpage
1436
Lastpage
1441
Abstract
This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP´s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of an averaged model in which the regimes within the same class are aggregated through a quasi-stationary distribution. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.
Keywords
Markov processes; convergence; optimal control; piecewise constant techniques; singularly perturbed systems; Lipschitz continuity condition; discounted continuous control; optimality inequality; perturbed Markov chain; piecewise deterministic Markov process; quasistationary distribution; singular perturbation; uniqueness argument; value function; Aerospace electronics; Kernel; Markov processes; Measurement; Optimization; Process control; Topology;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control (CDC), 2010 49th IEEE Conference on
Conference_Location
Atlanta, GA
ISSN
0743-1546
Print_ISBN
978-1-4244-7745-6
Type
conf
DOI
10.1109/CDC.2010.5717626
Filename
5717626
Link To Document