DocumentCode
527609
Title
Newton´s Method for L∞ Support Vector Machine Via Smoothing technique
Author
Wang, Ruopeng ; Xu, Hongmin ; Shi, Hong
Author_Institution
Dept. of Math. & Phys., Beijing Inst. of Petrochem. Technol., Beijing, China
Volume
1
fYear
2010
fDate
10-12 Aug. 2010
Firstpage
436
Lastpage
440
Abstract
The standard 2-norm support vector machine (SVM for short) is known for its good performance in classification and regression problems. In this paper, the L∞ norm support vector machine is considered and a novel smoothing function method is proposed in an attempt to overcome some drawbacks of the former methods which are complex, subtle, and sometimes difficult to implement. Based on Karush-Kuhn-Tucker complementarity condition in optimization theory, unconstrained non-differentiable optimization model is built, and an approximate algorithm is presented. we take advantage of approximate smooth function and a Newton-Armijo algorithm is given to solve the corresponding optimization using difference convex algorithm. The paper trains the data sets with standard unconstraint optimization method. This algorithm is fast and insensitive to the initial point. Theory analysis and numerical results illustrate that the smoothing function method for the L∞ norm SVM is feasible and effective.
Keywords
Newton method; nonlinear programming; regression analysis; smoothing methods; support vector machines; 2-norm support vector machine; Karush Kuhn Tucker complementarity condition; L∞ support vector machine; Newton Armijo algorithm; Newton method; difference convex algorithm; regression problems; smoothing technique; unconstrained nondifferentiable optimization model; Approximation algorithms; Approximation methods; Machine learning; Optimization; Smoothing methods; Support vector machines; Vectors;
fLanguage
English
Publisher
ieee
Conference_Titel
Natural Computation (ICNC), 2010 Sixth International Conference on
Conference_Location
Yantai, Shandong
Print_ISBN
978-1-4244-5958-2
Type
conf
DOI
10.1109/ICNC.2010.5583331
Filename
5583331
Link To Document