Title :
Construction of Lyapunov functions for piecewise-deterministic Markov processes
Author :
Mesquita, Alexandre R. ; Hespanha, João P.
Author_Institution :
Center for Control, Dynamical Syst. & Comput., Univ. of California, Santa Barbara, CA, USA
Abstract :
The purpose of this contribution is twofold: 1) to present for the first time a Lyapunov function that proves exponential ergodicity of a process studied by the authors in, where the problem of controlling the probability density of a swarm of robotic agents was solved; 2) to introduce alongside the method used to construct this Lyapunov function, which is of interest in its own since it may be applicable to a wide class of piecewise-deterministc Markov processes. Our method searches for the Lyapunov function that maximizes a measure of the rate of convergence that appears in the theory of large deviations. Analytical solutions are often possible as shown by examples.
Keywords :
Lyapunov methods; Markov processes; probability; Lyapunov function constructions; exponential ergodicity; piecewise deterministic Markov processes; probability density; robotic agents; Convergence; Generators; Kernel; Lyapunov method; Markov processes; Steady-state; Vehicles;
Conference_Titel :
Decision and Control (CDC), 2010 49th IEEE Conference on
Conference_Location :
Atlanta, GA
Print_ISBN :
978-1-4244-7745-6
DOI :
10.1109/CDC.2010.5717973