Title :
SVM optimization algorithm based on dynamic clustering and ensemble learning for large scale dataset
Author :
Shiyu Shu ; Lihong Ren ; Yongsheng Ding ; Kuangrong Hao ; Rui Jiang
Author_Institution :
Coll. of Inf. Sci. & Technol., Donghua Univ., Shanghai, China
Abstract :
This paper studies on the predicted regression model of support vector machines (SVM). Aiming at the shortage that with the amount of samples grows, training time increases rapidly as well, we propose an optimization algorithm to optimize it for large scale dataset. The optimization algorithm is based on ensemble learning and dynamic clustering. Firstly, we use dynamic cluster method to generate different types of sub training set based on fuzzy granular. Then we construct SVM sub-learners. Afterwards we synthesize outputs of each sub-learner by using the strategy of mean squared error. Simulation experimental results demonstrate that the optimization algorithm can increase training speed obviously, and keep the original accuracy compared to traditional SVM.
Keywords :
fuzzy set theory; mean square error methods; optimisation; pattern clustering; regression analysis; support vector machines; SVM optimization algorithm; SVM sub-learners; dynamic clustering method; ensemble learning; fuzzy granular; large scale dataset; mean squared error strategy; regression model; subtraining set; support vector machines; Classification algorithms; Clustering algorithms; Heuristic algorithms; Optimization; Prediction algorithms; Support vector machines; Training; SVM; dynamic clustering; ensemble learning; predicted regression;
Conference_Titel :
Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on
Conference_Location :
San Diego, CA
DOI :
10.1109/SMC.2014.6974265