Title :
Kernel evolution for support vector classification
Author :
Alizadeh, Mehrdad ; Ebadzadeh, Mohammad Mehdi
Author_Institution :
Comput. Eng. & IT Dept., Amirkabir Univ. of Technol., Tehran, Iran
Abstract :
Support vector machines (SVMs) have been used in a variety of classification tasks. SVMs undoubtedly are one of the most effective classifiers in several data mining applications. Determination of a kernel function and related parameters has been a bottleneck for this group of classifiers. In this paper a novel approach is proposed to use genetic programming (GP) to design domain-specific and optimal kernel functions for support vector classification (SVC) which automatically adjusts the parameters. Complex low dimensional mapping function is evolved using GP to construct an optimal linear and Gaussian kernel functions in new feature space. By using the principled kernel closure properties, these basic kernels are then used to evolve more optimal kernels. To evaluate the proposed method, benchmark datasets from UCI are applied. The result indicates that for some cases the proposed methods can find a more optimal solution than evolving known kernels.
Keywords :
Gaussian processes; data mining; genetic algorithms; pattern classification; support vector machines; Gaussian kernel functions; automatic parameter adjustment; classification task; data mining application; domain-specific kernel functions; feature space; genetic programming; kernel evolution; low dimensional mapping function; optimal kernel functions; optimal linear functions; principled kernel closure properties; support vector classification; support vector machines; Genetic algorithms; Genetic programming; Kernel; Support vector machine classification; Training; Vectors; Genetic Programming; Kernel Evolution; Support Vector Machines;
Conference_Titel :
Evolving and Adaptive Intelligent Systems (EAIS), 2011 IEEE Workshop on
Conference_Location :
Paris
Print_ISBN :
978-1-4244-9978-6
DOI :
10.1109/EAIS.2011.5945924