DocumentCode
1707046
Title
Some recovery conditions for basis learning by L1-minimization
Author
Gribonval, Rémi ; Schnass, Karin
Author_Institution
Centre de Rech. INRIA Rennes - Bretagne Atlantique, IRISA, Rennes
fYear
2008
Firstpage
768
Lastpage
773
Abstract
Many recent works have shown that if a given signal admits a sufficiently sparse representation in a given dictionary, then this representation is recovered by several standard optimization algorithms, in particular the convex l1 minimization approach. Here we investigate the related problem of inferring the dictionary from training data, with an approach where l1- minimization is used as a criterion to select a dictionary. We restrict our analysis to basis learning and identify necessary / sufficient / necessary and sufficient conditions on ideal (not necessarily very sparse) coefficients of the training data in an ideal basis to guarantee that the ideal basis is a strict local optimum of the A -minimization criterion among (not necessarily orthogonal) bases of normalized vectors. We illustrate these conditions on deterministic as well as toy random models in dimension two and highlight the main challenges that remain open by this preliminary theoretical results.
Keywords
independent component analysis; minimisation; signal representation; sparse matrices; ICA; L1-minimization; dictionary learning; matrix algebra; normalized vector; optimization; sparse signal representation; Dictionaries; Harmonic analysis; Independent component analysis; Matching pursuit algorithms; Minimization methods; Noise reduction; Signal processing; Signal processing algorithms; Sufficient conditions; Training data; Sparse representation; dictionary learning; independent component analysis; nonconvex optimization;
fLanguage
English
Publisher
ieee
Conference_Titel
Communications, Control and Signal Processing, 2008. ISCCSP 2008. 3rd International Symposium on
Conference_Location
St Julians
Print_ISBN
978-1-4244-1687-5
Electronic_ISBN
978-1-4244-1688-2
Type
conf
DOI
10.1109/ISCCSP.2008.4537326
Filename
4537326
Link To Document