• DocumentCode
    1707046
  • Title

    Some recovery conditions for basis learning by L1-minimization

  • Author

    Gribonval, Rémi ; Schnass, Karin

  • Author_Institution
    Centre de Rech. INRIA Rennes - Bretagne Atlantique, IRISA, Rennes
  • fYear
    2008
  • Firstpage
    768
  • Lastpage
    773
  • Abstract
    Many recent works have shown that if a given signal admits a sufficiently sparse representation in a given dictionary, then this representation is recovered by several standard optimization algorithms, in particular the convex l1 minimization approach. Here we investigate the related problem of inferring the dictionary from training data, with an approach where l1- minimization is used as a criterion to select a dictionary. We restrict our analysis to basis learning and identify necessary / sufficient / necessary and sufficient conditions on ideal (not necessarily very sparse) coefficients of the training data in an ideal basis to guarantee that the ideal basis is a strict local optimum of the A -minimization criterion among (not necessarily orthogonal) bases of normalized vectors. We illustrate these conditions on deterministic as well as toy random models in dimension two and highlight the main challenges that remain open by this preliminary theoretical results.
  • Keywords
    independent component analysis; minimisation; signal representation; sparse matrices; ICA; L1-minimization; dictionary learning; matrix algebra; normalized vector; optimization; sparse signal representation; Dictionaries; Harmonic analysis; Independent component analysis; Matching pursuit algorithms; Minimization methods; Noise reduction; Signal processing; Signal processing algorithms; Sufficient conditions; Training data; Sparse representation; dictionary learning; independent component analysis; nonconvex optimization;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Communications, Control and Signal Processing, 2008. ISCCSP 2008. 3rd International Symposium on
  • Conference_Location
    St Julians
  • Print_ISBN
    978-1-4244-1687-5
  • Electronic_ISBN
    978-1-4244-1688-2
  • Type

    conf

  • DOI
    10.1109/ISCCSP.2008.4537326
  • Filename
    4537326