• DocumentCode
    698339
  • Title

    Can we always trust entropy minima in the ICA context?

  • Author

    Vrins, Frederic ; Lee, John A. ; Verleysen, Michel

  • Author_Institution
    Machine Learning Group, Univ. catholique de Louvain (UCL), Louvain-la-Neuve, Belgium
  • fYear
    2005
  • fDate
    4-8 Sept. 2005
  • Firstpage
    1
  • Lastpage
    4
  • Abstract
    Marginal entropy can be used as cost function for blind source separation (BSS). Recently, some authors have experimentally shown that such information-theoretic cost function may have spurious minima in specific situations. Hence, one could face spurious solutions of the BSS problem even if the mixture model is known, exactly as when using the maximum-likelihood criterion. Intuitive justifications of the spurious minima have been proposed, when the sources have multimodal densities. This paper aims to give mathematical arguments, complementary to existing simulation results, to explain the existence of such minima. This is done by first deriving a specific entropy estimator. Then, this estimator, although reliable only for multimodal sources with small-overlapping Gaussian modes, allows one to show that spurious minima may exist when dealing with such sources.
  • Keywords
    blind source separation; entropy; independent component analysis; ICA; blind source separation; cost function; entropy estimator; entropy minima; marginal entropy; maximum-likelihood estimation; mixture model; multimodal source; small overlapping Gaussian modes; spurious minima; Approximation methods; Cost function; Entropy; Manifolds; Probability density function; Random variables; Source separation;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Signal Processing Conference, 2005 13th European
  • Conference_Location
    Antalya
  • Print_ISBN
    978-160-4238-21-1
  • Type

    conf

  • Filename
    7077922