Title :
Parameter Optimization for SVM using Sequential Number Theoretic for Optimization
Author :
Yang, Hui-zhi ; Jiao, Xiao-nan ; Zhang, Li-qun ; Li, Fa-chao
Author_Institution :
Coll. of Econ. & Manage., Hebei Univ. of Sci. & Technol., Shijiazhuang
Abstract :
In this paper, we propose a support vector machine (SVM) meta-parameter optimization method which uses sequential number theoretic optimization (SNTO) and gradient information for better optimization performance. SNTO is a new global optimization approach whose foundation is numeric and statistic theory. This method has less computation time than genetic algorithm (GA) based and grid search based methods and better performance on finding global optimal value than gradient based methods. Simulations demonstrate that it is robust and works effectively and efficiently on a variety of problems
Keywords :
gradient methods; number theory; optimisation; statistical analysis; support vector machines; SNTO approach; SVM meta-parameter optimization method; sequential number theoretic optimization; statistic theory; Computational modeling; Conference management; Cybernetics; Educational institutions; Genetic algorithms; Grid computing; Kernel; Machine learning; Optimization methods; Statistics; Support vector machine classification; Support vector machines; Technology management; SNTO; Support Vector Machines (SVM); gradient descent method; meta-parameter selection;
Conference_Titel :
Machine Learning and Cybernetics, 2006 International Conference on
Conference_Location :
Dalian, China
Print_ISBN :
1-4244-0061-9
DOI :
10.1109/ICMLC.2006.258515