DocumentCode :
1233294
Title :
Observable augmented systems for sensitivity analysis of Markov and semi-Markov processes
Author :
Cassandras, Christos G. ; Strickland, Stephen G.
Author_Institution :
Dept. of Electr. & Comput. Eng., Massachusetts Univ., Amherst, MA, USA
Volume :
34
Issue :
10
fYear :
1989
fDate :
10/1/1989 12:00:00 AM
Firstpage :
1026
Lastpage :
1037
Abstract :
Previous work by the authors (1989) on sensitivity analysis of discrete-event systems (DESs), where an augmented chain approach for estimating performance sensitivities from a single nominal sample path was developed, is extended. In contrast to existing methods, this approach can be applied to cases involving discrete (e.g. integer-valued) parameters such as queue capacities or routing thresholds. However, the basic method is limited by some rather restrictive observability conditions. These conditions are relaxed through an observability transformation which generalizes the method´s applicability. Direct extensions to more general (non-Markovian) DES are also presented via a simplified generalized semi-Markov process reformulation of the approach. Experimental verification of the techniques is included
Keywords :
Markov processes; discrete systems; observability; queueing theory; sensitivity analysis; state estimation; augmented chain approach; discrete-event systems; observability conditions; observability transformation; performance sensitivities; queue capacities; routing thresholds; semi-Markov processes; sensitivity analysis; Computational modeling; Control systems; Discrete event systems; Markov processes; Observability; Performance analysis; Routing; Sensitivity analysis; State estimation; Stochastic processes;
fLanguage :
English
Journal_Title :
Automatic Control, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9286
Type :
jour
DOI :
10.1109/9.35272
Filename :
35272
Link To Document :
بازگشت