Title :
Analysis of Mismatched Estimation Errors Using Gradients of Partition Functions
Author :
Huleihel, Wasim ; Merhav, Neri
Author_Institution :
Dept. of Electr. Eng., Technion - Israel Inst. of Technol., Haifa, Israel
Abstract :
We consider the problem of signal estimation (denoising) from a statistical-mechanical perspective, in continuation to a recent work on the analysis of mean-square error (MSE) estimation using a direct relationship between optimum estimation and certain partition functions. This paper consists of essentially two parts. In the first part, using the aforementioned relationship, we derive single-letter expressions of the asymptotic mismatched MSE of a codeword (from a randomly selected code), corrupted by a Gaussian vector channel. In the second part, we provide several examples to demonstrate phase transitions in the behavior of the MSE. These examples enable us to understand more deeply and to gather intuition regarding the roles of the real and the mismatched probability measures in creating these phase transitions.
Keywords :
Gaussian channels; mean square error methods; signal denoising; Gaussian vector channel; MSE estimation; mean-square error estimation; mismatched estimation error; optimum estimation; partition function gradient; randomly selected code; signal denoising; signal estimation; statistical-mechanical perspective; Channel estimation; Estimation error; Joints; Mean square error methods; Signal to noise ratio; Vectors; Minimum mean-square error (MMSE); conditional mean estimation; mismatched MSE; partition function; phase transitions; statistical mechanics; threshold effect;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2014.2301436