Title :
Efficient Algorithm for Localized Support Vector Machine
Author :
Cheng, Haibin ; Tan, Pang-Ning ; Jin, Rong
Author_Institution :
Yahoo! Labs., Santa Clara, CA, USA
fDate :
4/1/2010 12:00:00 AM
Abstract :
This paper presents a framework called localized support vector machine (LSVM) for classifying data with nonlinear decision surfaces. Instead of building a sophisticated global model from the training data, LSVM constructs multiple linear SVMs, each of which is designed to accurately classify a given test example. A major limitation of this framework is its high computational cost since a unique model must be constructed for each test example. To overcome this limitation, we propose an efficient implementation of LSVM, termed profile SVM (PSVM). PSVM partitions the training examples into clusters and builds a separate linear SVM model for each cluster. Our empirical results show that (1) LSVM and PSVM outperform nonlinear SVM for all 20 of the evaluated data sets and (2) PSVM achieves comparable performance as LSVM in terms of model accuracy but with significant computational savings. We also demonstrate the efficacy of the proposed approaches in terms of classifying data with spatial and temporal dependencies.
Keywords :
pattern classification; support vector machines; data classification; localized support vector machine; multiple linear SVM; termed profile SVM; Classification; kernel-based learning; local learning.; support vector machine;
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
DOI :
10.1109/TKDE.2009.116