Title :
Approximate inference in hidden Markov models using iterative active state selection
Author :
Vithanage, C.M. ; Andrieu, C. ; Piechocki, R.J.
Author_Institution :
Dept. of Math., Univ. of Bristol, Bristol, UK
Abstract :
The inferential task of computing the marginal posterior probability mass functions of state variables and pairs of consecutive state variables of a hidden Markov model is considered. This can be exactly and efficiently performed using a message passing scheme such as the Bahl-Cocke-Jelinek-Raviv (BCJR) algorithm. We present a novel iterative reduced complexity variation of the BCJR algorithm that uses reduced support approximations for the forward and backward messages, as in the M-BCJR algorithm. Forward/backward message computation is based on the concept of expectation propagation, which results in an algorithm similar to the M-BCJR algorithm with the active state selection criterion being changed from the filtered distribution of state variables to beliefs of state variables. By allowing possibly different supports for the forward and backward messages, we derive identical forward and backward recursions that can be iterated. Simulation results of application for trellis-based equalization of a wireless communication system confirm the improved performance over the M-BCJR algorithm.
Keywords :
approximation theory; computational complexity; deterministic algorithms; equalisers; hidden Markov models; inference mechanisms; iterative decoding; message passing; probability; radiocommunication; recursive estimation; state-space methods; trellis codes; BCJR algorithm; HMM; active state selection iteration; deterministic algorithm; expectation propagation; forward-backward recursion; hidden Markov model; inference approximation; iterative reduced complexity variation; marginal posterior probability; mass function; message passing scheme; reduced support approximation; state space method; trellis-based equalization; wireless communication system; Distributed computing; Equalizers; Frequency; Hidden Markov models; Iterative algorithms; Message passing; Receiving antennas; Signal processing algorithms; Transmitting antennas; Wireless communication; Deterministic algorithms; equalizers; hidden Markov models (HMMs); message passing; state space methods;
Journal_Title :
Signal Processing Letters, IEEE
DOI :
10.1109/LSP.2005.861600