DocumentCode :
1131217
Title :
General Smoothing Formulas for Markov-Modulated Poisson Observations
Author :
Elliott, Robert J. ; Malcolm, W.P.
Author_Institution :
Haskayne Sch. of Bus., Univ. of Calgary, Alta., Canada
Volume :
50
Issue :
8
fYear :
2005
Firstpage :
1123
Lastpage :
1134
Abstract :
In this paper, we compute general smoothing dynamics for partially observed dynamical systems generating Poisson observations. We consider two model classes, each Markov modulated Poisson processes, whose stochastic intensities depend upon the state of an unobserved Markov process. In one model class, the hidden state process is a continuously-valued ItÔ process, which gives rise to a continuous sample-path stochastic intensity. In the other model class, the hidden state process is a continuous-time Markov chain, giving rise to a pure jump stochastic intensity. To compute filtered estimates of state process, we establish dynamics, whose solutions are unnormalized marginal probabilities; however, these dynamics include Lebesgue–Stieltjes stochastic integrals. By adapting the transformation techniques introduced by J. M. C. Clark, we compute filter dynamics which do not include these stochastic integrals. To construct smoothers, we exploit a duality between our forward and backward transformed dynamics and thereby completely avoid the technical complexities of backward evolving stochastic integral equations. The general smoother dynamics we present can readily be applied to specific smoothing algorithms, referred to in the literature as: Fixed point smoothing, fixed lag smoothing and fixed interval smoothing. It is shown that there is a clear motivation to compute smoothers via transformation techniques similar to those presented by J. M. C. Clark, that is, our smoothers are easily obtained without recourse to two sided stochastic integration. A computer simulation is included.
Keywords :
Markov processes; continuous time systems; duality (mathematics); integral equations; observers; smoothing methods; time-varying systems; Markov modulated Poisson observation; continuous time Markov chain; duality; filter dynamics; general smoothing formulas; hidden state process; partially observed dynamical system; stochastic integral equations; Australia Council; Filters; Forward contracts; History; Integral equations; Intensity modulation; Markov processes; Smoothing methods; State estimation; Stochastic processes; Filtering; Poisson processes; martingales; reference probability; smoothing;
fLanguage :
English
Journal_Title :
Automatic Control, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9286
Type :
jour
DOI :
10.1109/TAC.2005.852565
Filename :
1492556
Link To Document :
بازگشت