Title :
Robust Novelty Detection via Worst Case CVaR Minimization
Author :
Yongqiao Wang ; Chuangyin Dang ; Shouyang Wang
Author_Institution :
Sch. of Finance, Zhejiang Gongshang Univ., Hangzhou, China
Abstract :
Novelty detection models aim to find the minimum volume set covering a given probability mass. This paper proposes a robust single-class support vector machine (SSVM) for novelty detection, which is mainly based on the worst case conditional value-at-risk minimization. By assuming that every input is subject to an uncertainty with a specified symmetric support, this robust formulation results in a maximization term that is similar to the regularization term in the classical SSVM. When the uncertainty set is ℓ1-norm, ℓ∞-norm or box, its training can be reformulated to a linear program; while the uncertainty set is ℓ2-norm or ellipsoidal, its training is a tractable secondorder cone program. The proposed method has a nice consistent statistical property. As the training size goes to infinity, the estimated normal region converges to the true provided that the magnitude of the uncertainty set decreases in a systematic way. The experimental results on three data sets clearly demonstrate its superiority over three benchmark models.
Keywords :
data analysis; linear programming; optimisation; support vector machines; RSSVM; box uncertainty set; conditional value-at-risk; ellipsoidal uncertainty set; l∞-norm; l1-norm; l2-norm; linear program; maximization term; novelty detection; probability mass; regularization term; robust SSVM; single-class support vector machine; statistical property; tractable second-order cone program; volume set covering; worst case CVaR minimization; Kernel; Minimization; Optimization; Robustness; Support vector machines; Uncertainty; Vectors; Conditional value-at-risk (CVaR); kernel methods; novelty detection; robust programming; single-class support vector machine (SSVM); single-class support vector machine (SSVM).;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2014.2378270