Title :
Asymmetric Mixture Model With Simultaneous Feature Selection and Model Detection
Author :
Thanh Minh Nguyen ; Wu, Q. M. Jonathan ; Hui Zhang
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Windsor, Windsor, ON, Canada
Abstract :
A mixture model based on the symmetric Gaussian distribution that simultaneously treats the feature selection, and the model detection has recently received great attention for pattern recognition problems. However, in many applications, the distribution of the data has a non-Gaussian and nonsymmetric form. This brief presents a new asymmetric mixture model for model detection and model selection. In this brief, the proposed asymmetric distribution is modeled with multiple student´s-t distributions, which are heavily tailed and more robust than Gaussian distributions. Our method has the flexibility to fit different shapes of observed data, such as non-Gaussian and nonsymmetric. Another advantage is that the proposed algorithm, which is based on the variational Bayesian learning, can simultaneously optimize over the number of the student´s-t distribution that is used to model each asymmetric distribution, the number of components, and the saliency of the features. Numerical experiments on both synthetic and realworld datasets are conducted. The performance of the proposed model is compared with other mixture models, demonstrating the robustness, accuracy, and effectiveness of our method.
Keywords :
Bayes methods; Gaussian distribution; feature selection; learning (artificial intelligence); asymmetric mixture model; feature saliency; model detection; model selection; pattern recognition problems; realworld datasets; simultaneous feature selection; student-t distributions; symmetric Gaussian distribution; synthetic datasets; variational Bayesian learning; Clustering algorithms; Data models; Feature extraction; Gaussian distribution; Learning systems; Noise measurement; Robustness; Asymmetric mixture model; feature selection; model detection; student´s- $t$ distribution; student´s-t distribution; variational Bayesian (VB) learning;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2014.2314239