Title :
Improved LS-SVM based classifier design and its application
Author :
Peng Wang ; Ai-jun Yan
Author_Institution :
Coll. of Electron. Inf. & Control Eng, Beijing Univ. of Technol., Beijing, China
Abstract :
For least squares support vector machine (LS-SVM) classifier to the loss of sparseness and generalization, a pruning modeling method is proposed based on Quadratic Renyi entropy. The kernel principal component is adopted for data pre-processing, and the training set is divided randomly. Then the concept of quadratic Renyi entropy is introduced as the basis of training and pruning in LS-SVM classifier. UCI typical datasets of classification are used for testing the performance of this new model. Experimental results show that the new algorithm takes full account the location of the Lagrange multiplier, thus the sparseness and generalization ability of the classifier can be improved.
Keywords :
entropy; generalisation (artificial intelligence); least squares approximations; pattern classification; principal component analysis; sparse matrices; support vector machines; LS-SVM-based classifier design; Lagrange multiplier; UCI datasets; data preprocessing; generalization ability; kernel principal component; least squares support vector machine classifier; pruning modeling method; quadratic Renyi entropy; sparseness ability; training set; Breast; Classification algorithms; Educational institutions; Entropy; Glass; Heart; Support vector machines; LS-SVM; Pruning; Quadratic Renyi Entropy; Sparseness;
Conference_Titel :
Intelligent Control and Automation (WCICA), 2012 10th World Congress on
Conference_Location :
Beijing
Print_ISBN :
978-1-4673-1397-1
DOI :
10.1109/WCICA.2012.6359152