Title :
Summarizing posterior distributions in signal decomposition problems when the number of components is unknown
Author :
Roodaki, Alireza ; Bect, Julien ; Fleury, Gilles
Author_Institution :
Dept. of Signal Process. & Electron. Syst., SUPELEC, Gif-sur-Yvette, France
Abstract :
This paper addresses the problem of summarizing the posterior distributions that typically arise, in a Bayesian framework, when dealing with signal decomposition problems with unknown number of components. Such posterior distributions are defined over union of subspaces of differing dimensionality and can be sampled from using modern Monte Carlo techniques, for instance the increasingly popular RJ-MCMC method. No generic approach is available, however, to summarize the resulting variable-dimensional samples and extract from them component-specific parameters. We propose a novel approach to this problem, which consists in approximating the complex posterior of interest by a "simple"-but still variable-dimensional-parametric distribution. The distance between the two distributions is measured using the Kullback-Leibler divergence, and a Stochastic EM-type algorithm, driven by the RJ-MCMC sampler, is proposed to estimate the parameters. The proposed algorithm is illustrated on the fundamental signal processing example of joint detection and estimation of sinusoids in white Gaussian noise.
Keywords :
AWGN; Bayes methods; Markov processes; Monte Carlo methods; parameter estimation; signal detection; stochastic processes; Bayesian framework; Kullback-Leibler divergence; Markov chain Monte Carlo sampling method; RJ-MCMC method; component-specific parameter; generic approach; parameter estimation; posterior distribution summarization; signal decomposition problem; signal detection; signal processing; sinusoid estimation; stochastic EM-type algorithm; variable-dimensional sampling; variable-dimensional-parametric distribution; white Gaussian noise; Algorithm design and analysis; Approximation algorithms; Bayesian methods; Parametric statistics; Robustness; Signal processing algorithms; Vectors; Bayesian inference; Label-switching; Posterior summarization; Stochastic EM; Trans-dimensional MCMC;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on
Conference_Location :
Kyoto
Print_ISBN :
978-1-4673-0045-2
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2012.6288763