Title :
Increasing the frequency of regeneration for Markov processes
Author :
Andradóttir, Sigrun ; Calvin, James M. ; Glynn, Peter W.
Author_Institution :
Dept. of Ind. Eng., Wisconsin Univ., Madison, WI, USA
Abstract :
We present and compare two ways of applying the regenerative method of simulation output analysis to simulate the steady-state behavior of irreducible discrete time Markov chains having a finite state space. The "standard" approach involves defining the regenerative cycles based on the times a particular "return" state is visited. The alternative approach involves using "splitting" to define the regenerative cycles. We present a way of selecting the splitting distribution that guarantees that the splitting cycles are shorter than the standard cycles, and that the variance estimates produced by the splitting approach are less variable than the variance estimates produced by the standard approach.
Keywords :
Markov processes; simulation; Markov processes; finite state space; frequency of regeneration; irreducible discrete time Markov chains; simulation output analysis; splitting cycles; steady-state behavior; variance estimates; Analytical models; Computational modeling; Frequency; Industrial engineering; Markov processes; State estimation; State-space methods; Steady-state; Stochastic processes; Systems engineering and theory;
Conference_Titel :
Simulation Conference Proceedings, 1994. Winter
Print_ISBN :
0-7803-2109-X
DOI :
10.1109/WSC.1994.717167