• DocumentCode
    3433294
  • Title

    Efficient stochastic simulation of metastable Markov chains

  • Author

    Milias-Argeitis, Andreas ; Lygeros, John

  • Author_Institution
    Automatic Control Laboratory, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
  • fYear
    2011
  • fDate
    12-15 Dec. 2011
  • Firstpage
    2239
  • Lastpage
    2244
  • Abstract
    We address the problem of metastable Markov chain simulation, a class of systems characterized by the existence of two or more “pseudo-equilibrium” states and very slow convergence towards global equilibrium [1]. For such systems, approximation of the stationary distribution by direct application of the Stochastic Simulation Algorithm (SSA) [2] would be very inefficient. In this paper we propose a new method for steady-state simulation of metastable chains that is centered around the concept of stochastic complementation [3]. The use of this mathematical device along with SSA results in an algorithm with much better convergence properties, that facilitates the analysis of rarely switching stochastic biochemical systems.
  • Keywords
    Approximation methods; Bismuth; Computational modeling; Couplings; Markov processes; Switches; Trajectory;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control and European Control Conference (CDC-ECC), 2011 50th IEEE Conference on
  • Conference_Location
    Orlando, FL, USA
  • ISSN
    0743-1546
  • Print_ISBN
    978-1-61284-800-6
  • Electronic_ISBN
    0743-1546
  • Type

    conf

  • DOI
    10.1109/CDC.2011.6160818
  • Filename
    6160818