Title :
Robust and sparse estimation of tensor decompositions
Author :
Hyon-Jung Kim ; Ollila, Esa ; Koivunen, Visa ; Croux, Christophe
Author_Institution :
Dept. of Signal Process. & Acoust., Aalto Univ., Aalto, Finland
Abstract :
We propose novel tensor decomposition methods that advocate both properties of sparsity and robustness to outliers. The sparsity enables us to extract some essential features from a big data that are easily interpretable. The robustness ensures the resistance to outliers that appear commonly in high-dimensional data. We first propose a method that generalizes the ridge regression in M-estimation framework for tensor decompositions. The other approach we propose combines the least absolute deviation (LAD) regression and the least absolute shrinkage operator (LASSO) for the CANDECOMP/PARAFAC (CP) tensor decompositions. We also formulate various robust tensor decomposition methods using different loss functions. The simulation study shows that our robust-sparse methods outperform other general tensor decomposition methods in the presence of outliers.
Keywords :
regression analysis; tensors; CANDECOMP-PARAFAC tensor decompositions; LAD regression; LASSO operator; M-estimation framework; big data; least absolute deviation; least absolute shrinkage operator; loss functions; outlier robustness property; ridge regression; robust-sparse methods; sparsity property; tensor decomposition methods; Estimation; Linear programming; Noise; Robustness; Sparse matrices; Tensile stress; Vectors;
Conference_Titel :
Global Conference on Signal and Information Processing (GlobalSIP), 2013 IEEE
Conference_Location :
Austin, TX
DOI :
10.1109/GlobalSIP.2013.6737053