• DocumentCode
    527609
  • Title

    Newton´s Method for L Support Vector Machine Via Smoothing technique

  • Author

    Wang, Ruopeng ; Xu, Hongmin ; Shi, Hong

  • Author_Institution
    Dept. of Math. & Phys., Beijing Inst. of Petrochem. Technol., Beijing, China
  • Volume
    1
  • fYear
    2010
  • fDate
    10-12 Aug. 2010
  • Firstpage
    436
  • Lastpage
    440
  • Abstract
    The standard 2-norm support vector machine (SVM for short) is known for its good performance in classification and regression problems. In this paper, the L norm support vector machine is considered and a novel smoothing function method is proposed in an attempt to overcome some drawbacks of the former methods which are complex, subtle, and sometimes difficult to implement. Based on Karush-Kuhn-Tucker complementarity condition in optimization theory, unconstrained non-differentiable optimization model is built, and an approximate algorithm is presented. we take advantage of approximate smooth function and a Newton-Armijo algorithm is given to solve the corresponding optimization using difference convex algorithm. The paper trains the data sets with standard unconstraint optimization method. This algorithm is fast and insensitive to the initial point. Theory analysis and numerical results illustrate that the smoothing function method for the L norm SVM is feasible and effective.
  • Keywords
    Newton method; nonlinear programming; regression analysis; smoothing methods; support vector machines; 2-norm support vector machine; Karush Kuhn Tucker complementarity condition; L support vector machine; Newton Armijo algorithm; Newton method; difference convex algorithm; regression problems; smoothing technique; unconstrained nondifferentiable optimization model; Approximation algorithms; Approximation methods; Machine learning; Optimization; Smoothing methods; Support vector machines; Vectors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Natural Computation (ICNC), 2010 Sixth International Conference on
  • Conference_Location
    Yantai, Shandong
  • Print_ISBN
    978-1-4244-5958-2
  • Type

    conf

  • DOI
    10.1109/ICNC.2010.5583331
  • Filename
    5583331