DocumentCode
1492028
Title
Single sample path-based sensitivity analysis of Markov processes using uniformization
Author
Liu, Zikuan ; Tu, Fengsheng
Author_Institution
Dept. of Appl. Math., Hebei Univ. of Technol., Tianjin, China
Volume
44
Issue
4
fYear
1999
fDate
4/1/1999 12:00:00 AM
Firstpage
872
Lastpage
875
Abstract
Using the notion of perturbation realization factor, Cao and Chen (1997) provide sensitivity formulas of discrete-time Markov chains and uniformizable Markov processes. In this paper, the estimators of the realization factors of a uniformizable Markov process are provided by its uniformized Markov chain. It is proved that estimators given by the uniformized Markov chain have smaller variances than those provided by the original Markov process, which are increasing functions of the uniformization parameter and thus have minimal solutions
Keywords
Markov processes; matrix algebra; perturbation techniques; probability; sensitivity analysis; Markov chains; Markov processes; perturbation; probability matrix; sensitivity analysis; single sample path; uniformization; Analytical models; Markov processes; Mathematics; Particle measurements; Performance analysis; Sensitivity analysis; State estimation; State-space methods; Stochastic processes; Uncertainty;
fLanguage
English
Journal_Title
Automatic Control, IEEE Transactions on
Publisher
ieee
ISSN
0018-9286
Type
jour
DOI
10.1109/9.754837
Filename
754837
Link To Document