DocumentCode
2827710
Title
Model reduction of nonreversible Markov chains
Author
Runolfsson, Thordur ; Ma, Yong
Author_Institution
Oklahoma Univ., Norman
fYear
2007
fDate
12-14 Dec. 2007
Firstpage
3739
Lastpage
3744
Abstract
In many uncertain complex systems it is observed that the system trajectories cluster in several subsets of the state space. In this paper we model the system behavior as a Markov process and consider the problem of finding a low dimensional approximation of the process that captures the clustering phenomena. Furthermore, we concentrate on Markov chain approximations on a finite state space of large dimension. The problem of finding an approximate low dimensional operator is much simpler when the Markov chain is reversible and several solution approaches have been developed for this case. Most of these approaches rely on spectral properties of the Markov chain. In this paper we consider the general nonreversible case. Our approach is based on a reversibilization procedure, spectral methods for the identification of the dominant components and constrained projection of the original system onto the low dimensional space.
Keywords
Markov processes; approximation theory; large-scale systems; reduced order systems; uncertain systems; Markov chain approximations; Markov process; approximate low dimensional operator; finite state space; model reduction; nonreversible markov chains; uncertain complex systems; Convergence; Eigenvalues and eigenfunctions; Markov processes; Probability distribution; Reduced order systems; Space stations; State-space methods; USA Councils;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control, 2007 46th IEEE Conference on
Conference_Location
New Orleans, LA
ISSN
0191-2216
Print_ISBN
978-1-4244-1497-0
Electronic_ISBN
0191-2216
Type
conf
DOI
10.1109/CDC.2007.4434771
Filename
4434771
Link To Document