Title :
Singular perturbation for the discounted continuous control of piecewise deterministic Markov processes
Author :
Costa, O.L.V. ; Dufour, F.
Author_Institution :
Dept. de Eng. de Telecomun. e Controle, Escola Politec. da Univ. de Sao Paulo, São Paulo, Brazil
Abstract :
This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP´s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of an averaged model in which the regimes within the same class are aggregated through a quasi-stationary distribution. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.
Keywords :
Markov processes; convergence; optimal control; piecewise constant techniques; singularly perturbed systems; Lipschitz continuity condition; discounted continuous control; optimality inequality; perturbed Markov chain; piecewise deterministic Markov process; quasistationary distribution; singular perturbation; uniqueness argument; value function; Aerospace electronics; Kernel; Markov processes; Measurement; Optimization; Process control; Topology;
Conference_Titel :
Decision and Control (CDC), 2010 49th IEEE Conference on
Conference_Location :
Atlanta, GA
Print_ISBN :
978-1-4244-7745-6
DOI :
10.1109/CDC.2010.5717626