DocumentCode
1683714
Title
Particle metropolis hastings using Langevin dynamics
Author
Dahlin, Johan ; Lindsten, Fredrik ; Schon, Thomas
Author_Institution
Div. of Autom. Control, Linkoping Univ., Linkoping, Sweden
fYear
2013
Firstpage
6308
Lastpage
6312
Abstract
Particle Markov Chain Monte Carlo (PMCMC) samplers allow for routine inference of parameters and states in challenging nonlinear problems. A common choice for the parameter proposal is a simple random walk sampler, which can scale poorly with the number of parameters. In this paper, we propose to use log-likelihood gradients, i.e. the score, in the construction of the proposal, akin to the Langevin Monte Carlo method, but adapted to the PMCMC framework. This can be thought of as a way to guide a random walk proposal by using drift terms that are proportional to the score function. The method is successfully applied to a stochastic volatility model and the drift term exhibits intuitive behaviour.
Keywords
Markov processes; Monte Carlo methods; signal sampling; Langevin dynamics; PMCMC samplers; log-likelihood gradients; nonlinear problems; particle Markov hain Monte Carlo samplers; particle metropolis hastings; random walk sampler; routine inference; stochastic volatility; Hidden Markov models; Kernel; Markov processes; Monte Carlo methods; Proposals; Smoothing methods; State-space methods; Bayesian inference; Langevin Monte Carlo; Particle Markov Chain Monte Carlo; Sequential Monte Carlo;
fLanguage
English
Publisher
ieee
Conference_Titel
Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on
Conference_Location
Vancouver, BC
ISSN
1520-6149
Type
conf
DOI
10.1109/ICASSP.2013.6638879
Filename
6638879
Link To Document