Title :
Exact simulation of continuous time Markov jump processes with anticorrelated variance reduced Monte Carlo estimation
Author :
Maginnis, Peter A. ; West, Matthew ; Dullerud, Geir E.
Author_Institution :
Univ. Illinois, Urbana, IL, USA
Abstract :
We provide an exact, continuous time extension to previous work in anticorrelated stochastic process simulation that was performed in an approximate, discrete time setting. These methods reduce the variance of continuous time Monte Carlo for Markov jump process systems. We rigorously construct antithetic Poisson processes and analytically prove the negative correlation between pairs. We then show how these anticorrelated Poisson processes can be used to drive Markov jump processes via a random time change representation. Finally, we provide a sufficient condition for variance reduction in the jump process context as well as demonstrate a simple example.
Keywords :
Markov processes; Monte Carlo methods; random processes; anticorrelated stochastic process simulation; anticorrelated variance reduced Monte Carlo estimation; antithetic Poisson processes; continuous time Markov jump processes; exact continuous time extension; negative correlation; random time change representation; Context; Correlation; Estimation; Markov processes; Monte Carlo methods; Random variables;
Conference_Titel :
Decision and Control (CDC), 2014 IEEE 53rd Annual Conference on
Conference_Location :
Los Angeles, CA
Print_ISBN :
978-1-4799-7746-8
DOI :
10.1109/CDC.2014.7039916