Title :
Selecting the hypothesis space for improving the generalization ability of Support Vector Machines
Author :
Anguita, Davide ; Ghio, Alessandro ; Oneto, Luca ; Ridella, Sandro
Author_Institution :
Dept. of Biophys. & Electron. Eng., Univ. of Genova, Opera, Italy
fDate :
July 31 2011-Aug. 5 2011
Abstract :
The Structural Risk Minimization framework has been recently proposed as a practical method for model selection in Support Vector Machines (SVMs). The main idea is to effectively measure the complexity of the hypothesis space, as defined by the set of possible classifiers, and to use this quantity as a penalty term for guiding the model selection process. Unfortunately, the conventional SVM formulation defines a hypothesis space centered at the origin, which can cause undesired effects on the selection of the optimal classifier. We propose here a more flexible SVM formulation, which addresses this drawback, and describe a practical method for selecting more effective hypothesis spaces, leading to the improvement of the generalization ability of the final classifier.
Keywords :
pattern classification; support vector machines; SVM formulation; complexity measurement; generalization ability; hypothesis space selection; model selection process; optimal classifier selection; structural risk minimization framework; support vector machines; Complexity theory; Computational modeling; Data models; Risk management; Support vector machines; Training; Tuning;
Conference_Titel :
Neural Networks (IJCNN), The 2011 International Joint Conference on
Conference_Location :
San Jose, CA
Print_ISBN :
978-1-4244-9635-8
DOI :
10.1109/IJCNN.2011.6033356