Title :
Observation noise-gain detection for Markov chains observed through scaled Brownian motion
Author :
Malcolm, W.P. ; Bensoussan, Alain
Author_Institution :
Math. Sci. Inst., Australian Nat. Univ., Canberra, ACT, Australia
Abstract :
In this preliminary article we consider the problem of estimating an unknown noise-gain for a Markov chain observed through a scaled Brownian motion. It is assumed that the unknown noise-gain is time invariant. Two objectives are addressed in this work, 1) compute an estimation scheme that is fast, and 2) compute an estimation scheme without recourse to stochastic integration. To address the first objective we avoid the Expectation Maximization (EM) algorithm, instead we develop an estimation scheme for a finite number of candidate model hypotheses. To address the second objective we develop a version of the Gauge-Transformation technique introduced by J. M. C. Clark.
Keywords :
Brownian motion; Markov processes; expectation-maximisation algorithm; stochastic processes; Gauge-transformation technique; Markov chains; Wonham Filter; candidate model hypotheses; expectation maximization; martingales; noise-gain detection; scaled brownian motion; Detectors; Filtering; Filters; Hidden Markov models; Motion control; Motion detection; Parameter estimation; State-space methods; Stochastic processes; Stochastic resonance; Detection; Filtering; Martingales; Reference Probability; Wonham Filter;
Conference_Titel :
Decision and Control, 2008. CDC 2008. 47th IEEE Conference on
Conference_Location :
Cancun
Print_ISBN :
978-1-4244-3123-6
Electronic_ISBN :
0191-2216
DOI :
10.1109/CDC.2008.4739239