Title :
Learning Gaussian mixture models by structural risk minimization
Author :
Wang, Li-Wei ; Feng, Ju-fu
Author_Institution :
Sch. of Electron. Eng. & Comput. Sci., Peking Univ., Beijing, China
Abstract :
Gaussian mixture models are often used for probability density estimation in pattern recognition and machine learning systems. Selecting an optimal number of components in mixture model is important to ensure an accurate and efficient estimate. In this paper, a methodology based on structural risk minimization is presented which trades off between training error and the model complexity. The main contribution of this work is that we give the capacity of an N-component GMM. When applied to unsupervised learning and speech recognition system, the new method shows good performance compared to classical model selection methods.
Keywords :
Gaussian processes; minimisation; probability; speech recognition; unsupervised learning; Gaussian mixture model; machine learning system; pattern recognition; probability density estimation; speech recognition system; structural risk minimization; unsupervised learning; Annealing; Computer science; EMP radiation effects; Entropy; Machine learning; Maximum likelihood estimation; Pattern recognition; Risk management; Speech recognition; Upper bound; Gaussian Mixture Models; Structural Risk Minimization; VC dimension;
Conference_Titel :
Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on
Conference_Location :
Guangzhou, China
Print_ISBN :
0-7803-9091-1
DOI :
10.1109/ICMLC.2005.1527798