• DocumentCode
    592612
  • Title

    Large deviations for systems driven by two-time-scale nonhomogeneous Markovian chains and applications to optimal control problems

  • Author

    He, Qian ; Yin, George ; Zhang, Qi

  • Author_Institution
    Dept. of Math., Univ. of California, Irvine, Irvine, CA, USA
  • fYear
    2012
  • fDate
    10-13 Dec. 2012
  • Firstpage
    5985
  • Lastpage
    5990
  • Abstract
    This paper is based on our paper [15]. We present the main results; the verbatim proofs are omitted due to the page limitation. We develop large deviations principles for systems driven by continuous-time Markov chains with two-time scales and related optimal control problems. A distinct feature of our setup is that the Markov chain under consideration is time dependent or inhomogeneous. The use of two-time-scale formulation stems from the effort of reducing computational complexity in a wide variety of applications in control, optimization, and systems theory. Then the results are applied to certain dynamic systems and LQ control problems.
  • Keywords
    Markov processes; computational complexity; continuous time systems; optimal control; LQ control problems; computational complexity; continuous-time Markov chains; distinct feature; large deviations; optimal control problem application; optimal control problems; page limitation; two time scale nonhomogeneous Markovian chains; verbatim proofs; Convergence; Differential equations; Generators; Markov processes; Matrix decomposition; Optimal control; Switches;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control (CDC), 2012 IEEE 51st Annual Conference on
  • Conference_Location
    Maui, HI
  • ISSN
    0743-1546
  • Print_ISBN
    978-1-4673-2065-8
  • Electronic_ISBN
    0743-1546
  • Type

    conf

  • DOI
    10.1109/CDC.2012.6426975
  • Filename
    6426975