• DocumentCode
    2575507
  • Title

    Singular perturbation for the discounted continuous control of piecewise deterministic Markov processes

  • Author

    Costa, O.L.V. ; Dufour, F.

  • Author_Institution
    Dept. de Eng. de Telecomun. e Controle, Escola Politec. da Univ. de Sao Paulo, São Paulo, Brazil
  • fYear
    2010
  • fDate
    15-17 Dec. 2010
  • Firstpage
    1436
  • Lastpage
    1441
  • Abstract
    This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP´s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of an averaged model in which the regimes within the same class are aggregated through a quasi-stationary distribution. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.
  • Keywords
    Markov processes; convergence; optimal control; piecewise constant techniques; singularly perturbed systems; Lipschitz continuity condition; discounted continuous control; optimality inequality; perturbed Markov chain; piecewise deterministic Markov process; quasistationary distribution; singular perturbation; uniqueness argument; value function; Aerospace electronics; Kernel; Markov processes; Measurement; Optimization; Process control; Topology;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control (CDC), 2010 49th IEEE Conference on
  • Conference_Location
    Atlanta, GA
  • ISSN
    0743-1546
  • Print_ISBN
    978-1-4244-7745-6
  • Type

    conf

  • DOI
    10.1109/CDC.2010.5717626
  • Filename
    5717626