Title :
Large deviations for systems driven by two-time-scale nonhomogeneous Markovian chains and applications to optimal control problems
Author :
He, Qian ; Yin, George ; Zhang, Qi
Author_Institution :
Dept. of Math., Univ. of California, Irvine, Irvine, CA, USA
Abstract :
This paper is based on our paper [15]. We present the main results; the verbatim proofs are omitted due to the page limitation. We develop large deviations principles for systems driven by continuous-time Markov chains with two-time scales and related optimal control problems. A distinct feature of our setup is that the Markov chain under consideration is time dependent or inhomogeneous. The use of two-time-scale formulation stems from the effort of reducing computational complexity in a wide variety of applications in control, optimization, and systems theory. Then the results are applied to certain dynamic systems and LQ control problems.
Keywords :
Markov processes; computational complexity; continuous time systems; optimal control; LQ control problems; computational complexity; continuous-time Markov chains; distinct feature; large deviations; optimal control problem application; optimal control problems; page limitation; two time scale nonhomogeneous Markovian chains; verbatim proofs; Convergence; Differential equations; Generators; Markov processes; Matrix decomposition; Optimal control; Switches;
Conference_Titel :
Decision and Control (CDC), 2012 IEEE 51st Annual Conference on
Conference_Location :
Maui, HI
Print_ISBN :
978-1-4673-2065-8
Electronic_ISBN :
0743-1546
DOI :
10.1109/CDC.2012.6426975