• DocumentCode
    42667
  • Title

    Nonstationary Source Separation Using Sequential and Variational Bayesian Learning

  • Author

    Jen-Tzung Chien ; Hsin-Lung Hsieh

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Nat. Chiao Tung Univ., Hsinchu, Taiwan
  • Volume
    24
  • Issue
    5
  • fYear
    2013
  • fDate
    May-13
  • Firstpage
    681
  • Lastpage
    694
  • Abstract
    Independent component analysis (ICA) is a popular approach for blind source separation where the mixing process is assumed to be unchanged with a fixed set of stationary source signals. However, the mixing system and source signals are nonstationary in real-world applications, e.g., the source signals may abruptly appear or disappear, the sources may be replaced by new ones or even moving by time. This paper presents an online learning algorithm for the Gaussian process (GP) and establishes a separation procedure in the presence of nonstationary and temporally correlated mixing coefficients and source signals. In this procedure, we capture the evolved statistics from sequential signals according to online Bayesian learning. The activity of nonstationary sources is reflected by an automatic relevance determination, which is incrementally estimated at each frame and continuously propagated to the next frame. We employ the GP to characterize the temporal structures of time-varying mixing coefficients and source signals. A variational Bayesian inference is developed to approximate the true posterior for estimating the nonstationary ICA parameters and for characterizing the activity of latent sources. The differences between this ICA method and the sequential Monte Carlo ICA are illustrated. In the experiments, the proposed algorithm outperforms the other ICA methods for the separation of audio signals in the presence of different nonstationary scenarios.
  • Keywords
    Gaussian processes; audio signal processing; belief networks; blind source separation; independent component analysis; inference mechanisms; learning (artificial intelligence); parameter estimation; time-varying systems; variational techniques; Gaussian process; audio signal separation; automatic relevance determination; blind source separation; independent component analysis; mixing system; nonstationary ICA parameter estimation; nonstationary source separation; online Bayesian learning; online learning algorithm; sequential Bayesian learning; sequential Monte Carlo ICA; stationary source signals; temporal structure characterization; temporally correlated mixing coefficients; time-varying mixing coefficients; variational Bayesian inference; variational Bayesian learning; Bayesian methods; Covariance matrix; Heuristic algorithms; Hidden Markov models; Mathematical model; Noise; Source separation; Bayes procedure; Gaussian process (GP); blind source separation (BSS); independent component analysis (ICA); online learning; variational method;
  • fLanguage
    English
  • Journal_Title
    Neural Networks and Learning Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    2162-237X
  • Type

    jour

  • DOI
    10.1109/TNNLS.2013.2242090
  • Filename
    6449323