• DocumentCode
    1131217
  • Title

    General Smoothing Formulas for Markov-Modulated Poisson Observations

  • Author

    Elliott, Robert J. ; Malcolm, W.P.

  • Author_Institution
    Haskayne Sch. of Bus., Univ. of Calgary, Alta., Canada
  • Volume
    50
  • Issue
    8
  • fYear
    2005
  • Firstpage
    1123
  • Lastpage
    1134
  • Abstract
    In this paper, we compute general smoothing dynamics for partially observed dynamical systems generating Poisson observations. We consider two model classes, each Markov modulated Poisson processes, whose stochastic intensities depend upon the state of an unobserved Markov process. In one model class, the hidden state process is a continuously-valued ItÔ process, which gives rise to a continuous sample-path stochastic intensity. In the other model class, the hidden state process is a continuous-time Markov chain, giving rise to a pure jump stochastic intensity. To compute filtered estimates of state process, we establish dynamics, whose solutions are unnormalized marginal probabilities; however, these dynamics include Lebesgue–Stieltjes stochastic integrals. By adapting the transformation techniques introduced by J. M. C. Clark, we compute filter dynamics which do not include these stochastic integrals. To construct smoothers, we exploit a duality between our forward and backward transformed dynamics and thereby completely avoid the technical complexities of backward evolving stochastic integral equations. The general smoother dynamics we present can readily be applied to specific smoothing algorithms, referred to in the literature as: Fixed point smoothing, fixed lag smoothing and fixed interval smoothing. It is shown that there is a clear motivation to compute smoothers via transformation techniques similar to those presented by J. M. C. Clark, that is, our smoothers are easily obtained without recourse to two sided stochastic integration. A computer simulation is included.
  • Keywords
    Markov processes; continuous time systems; duality (mathematics); integral equations; observers; smoothing methods; time-varying systems; Markov modulated Poisson observation; continuous time Markov chain; duality; filter dynamics; general smoothing formulas; hidden state process; partially observed dynamical system; stochastic integral equations; Australia Council; Filters; Forward contracts; History; Integral equations; Intensity modulation; Markov processes; Smoothing methods; State estimation; Stochastic processes; Filtering; Poisson processes; martingales; reference probability; smoothing;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/TAC.2005.852565
  • Filename
    1492556