Title :
Support vector machine classifiers using RBF kernels with clustering-based centers and widths
Author :
Daqi, Gao ; Tao, Zhang
Author_Institution :
East China Univ. of Sci. & Technol., Shanghai
Abstract :
This paper focuses on support vector machines (SVMs) with radial basis function (RBF) kernels to solve the large-scale classification problems. We decompose a large-scale learning problem into multiple two-class problems with the one-verse-all decomposition technique, and then propose an adoptively clustering method. An initial support vector (SV) coincides with a certain clustering center, and its width is equal to the max Euclid distance in the clustering region. Therefore, the initial number of SVs is equal to that of the clustering centers, and different RBF kernels are with different widths. The optimization of SVMs is only to determine the Lagrange multipliers. The resulting kernel space for optimization becomes relatively lower in dimensionality, and the final SVs are from a part of the clustering centers. The experimental results for the letter and the handwritten digit recognitions show that the proposed methods are effective.
Keywords :
learning (artificial intelligence); optimisation; pattern classification; pattern clustering; radial basis function networks; support vector machines; Euclid distance; Lagrange multiplier; SVM optimization; kernel space; learning; pattern clustering; radial basis function kernels; support vector machine classifiers; Computer science; Handwriting recognition; Kernel; Lagrangian functions; Large-scale systems; Neural networks; Quadratic programming; Support vector machine classification; Support vector machines; Training data;
Conference_Titel :
Neural Networks, 2007. IJCNN 2007. International Joint Conference on
Conference_Location :
Orlando, FL
Print_ISBN :
978-1-4244-1379-9
Electronic_ISBN :
1098-7576
DOI :
10.1109/IJCNN.2007.4371433