Title :
Distance measures for nonparametric weak process models
Author :
Sheng, Yong ; Cybenko, George V.
Author_Institution :
Thayer Sch. of Eng., Dartmouth Coll., Hanover, NH, USA
Abstract :
Nonparametric versions of hidden Markov models, what we call weak models, are robust for process detection and easy to construct, as the assumption of knowing precise probabilities in HMMs is weakened to {0,1}-values of reachabilities. Weak models are shown to be equivalent to DFAs/ NFAs. The concept of minimal unifilar weak model (μ-WM) is introduced. The spectral radius of the transition matrix of μ-WM determines the growth rate of acceptable observation sequences. An absolute weak model distance is defined for model clustering purpose, while a relative distance is a measure of how fast the performance of detection gets improved as more observations arrive. Convergence of the distance measures is proved.
Keywords :
hidden Markov models; modelling; nonparametric statistics; distance measure; model clustering; nonparametric hidden Markov model; nonparametric weak process model; process detection; transition matrix; unifilar weak model; weak model distance; Application software; Computer network management; Convergence; Educational institutions; Hidden Markov models; Robustness; State estimation; Surveillance; Terrorism; Viterbi algorithm; Weak models; counting; distance measure; nonparametric HMMs; process detection; unifilar models;
Conference_Titel :
Systems, Man and Cybernetics, 2005 IEEE International Conference on
Print_ISBN :
0-7803-9298-1
DOI :
10.1109/ICSMC.2005.1571232