Title :
Analysis operator learning for overcomplete cosparse representations
Author :
Yaghoobi, Mehrdad ; Sangnam Nam ; Gribonval, Remi ; Davies, Mike E.
Author_Institution :
Inst. for Digital Commun. (IDCom), Univ. of Edinburgh, Edinburgh, UK
fDate :
Aug. 29 2011-Sept. 2 2011
Abstract :
We consider the problem of learning a low-dimensional signal model from a collection of training samples. The mainstream approach would be to learn an overcomplete dictionary to provide good approximations of the training samples using sparse synthesis coefficients. This famous sparse model has a less well known counterpart, in analysis form, called the cosparse analysis model. In this new model, signals are characterized by their parsimony in a transformed domain using an overcomplete analysis operator. We propose to learn an analysis operator from a training corpus using a constrained optimization program based on L1 optimization. We derive a practical learning algorithm, based on projected subgradients, and demonstrate its ability to robustly recover a ground truth analysis operator, provided the training set is of sufficient size. A local optimality condition is derived, providing preliminary theoretical support for the well-posedness of the learning problem under appropriate conditions.
Keywords :
gradient methods; learning (artificial intelligence); optimisation; signal representation; signal sampling; signal synthesis; L1 optimization; analysis operator learning; constrained optimization program; cosparse analysis model; ground truth analysis operator; local optimality condition; low-dimensional signal model; overcomplete cosparse representations; overcomplete dictionary; projected subgradients; sparse synthesis coefficients; training corpus; training sample collection; Algorithm design and analysis; Analytical models; Dictionaries; Optimization; Signal processing algorithms; Training; Vectors;
Conference_Titel :
Signal Processing Conference, 2011 19th European
Conference_Location :
Barcelona