Title :
Model reduction of irreducible Markov chains
Author :
Kotsalis, Georgios ; Dahleh, Murither
Author_Institution :
Lab. for Inf. & Decision Syst., Massachusetts Inst. of Technol., Cambridge, MA, USA
Abstract :
We are interested in developing computational tools for reducing the state space of irreducible Markov chains. As means of decreasing the dimensionality of a given Markov chain we study the concept of aggregation. The approximation error between the original and the reduced order model is captured by a metric that penalizes the asymptotic deviation of the outputs of the two systems. For the case of nearly completely decomposable Markov chains we demonstrate how a decomposition approach can be used to derive a low order model of good fidelity.
Keywords :
Markov processes; reduced order systems; stochastic systems; aggregation; approximation error; decomposition approach; irreducible Markov chains; model reduction; Autonomous agents; Decision making; Distributed computing; Equations; Laboratories; Probability distribution; Reduced order systems; Space technology; State-space methods; Tin;
Conference_Titel :
Decision and Control, 2003. Proceedings. 42nd IEEE Conference on
Print_ISBN :
0-7803-7924-1
DOI :
10.1109/CDC.2003.1271917