DocumentCode
3433294
Title
Efficient stochastic simulation of metastable Markov chains
Author
Milias-Argeitis, Andreas ; Lygeros, John
Author_Institution
Automatic Control Laboratory, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
fYear
2011
fDate
12-15 Dec. 2011
Firstpage
2239
Lastpage
2244
Abstract
We address the problem of metastable Markov chain simulation, a class of systems characterized by the existence of two or more “pseudo-equilibrium” states and very slow convergence towards global equilibrium [1]. For such systems, approximation of the stationary distribution by direct application of the Stochastic Simulation Algorithm (SSA) [2] would be very inefficient. In this paper we propose a new method for steady-state simulation of metastable chains that is centered around the concept of stochastic complementation [3]. The use of this mathematical device along with SSA results in an algorithm with much better convergence properties, that facilitates the analysis of rarely switching stochastic biochemical systems.
Keywords
Approximation methods; Bismuth; Computational modeling; Couplings; Markov processes; Switches; Trajectory;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control and European Control Conference (CDC-ECC), 2011 50th IEEE Conference on
Conference_Location
Orlando, FL, USA
ISSN
0743-1546
Print_ISBN
978-1-61284-800-6
Electronic_ISBN
0743-1546
Type
conf
DOI
10.1109/CDC.2011.6160818
Filename
6160818
Link To Document