Title :
On MMSE Crossing Properties and Implications in Parallel Vector Gaussian Channels
Author :
Bustin, Ronit ; Payaro, Miquel ; Palomar, Daniel P. ; Shamai, Shlomo
Author_Institution :
Dept. of Electr. Eng., Technion - Israel Inst. of Technol., Haifa, Israel
Abstract :
The scalar additive Gaussian noise channel has the “single crossing point” property between the minimum mean square error (MMSE) in the estimation of the input given the channel output, assuming a Gaussian input to the channel, and the MMSE assuming an arbitrary input. This paper extends the result to the parallel vector additive Gaussian channel in three phases. The channel matrix is the identity matrix, and we limit the Gaussian input to a vector of Gaussian i.i.d. elements. The “single crossing point” property is with respect to the signal-to-noise ratio (as in the scalar case). The channel matrix is arbitrary, and the Gaussian input is limited to an independent Gaussian input. A “single crossing point” property is derived for each diagonal element of the MMSE matrix. The Gaussian input is allowed to be an arbitrary Gaussian random vector. A “single crossing point” property is derived for each eigenvalue of the difference matrix between the two MMSE matrices. These three extensions are then translated to new information theoretic properties on the mutual information, using the I-MMSE relationship, a fundamental relationship between estimation theory and information theory revealed by Guo and coworkers. The results of the last phase are also translated to a new property of Fisher information. Finally, the applicability of all three extensions on information theoretic problems is demonstrated through a proof of a special case of Shannon´s vector entropy power inequality, a converse proof of the capacity region of the parallel degraded broadcast channel (BC) under an input per-antenna power constraint and under an input covariance constraint, and a converse proof of the capacity region of the compound parallel degraded BC under an input covariance constraint.
Keywords :
AWGN channels; antennas; broadcast channels; channel estimation; covariance matrices; eigenvalues and eigenfunctions; estimation theory; least mean squares methods; random processes; vectors; Fisher information; Gaussian i.i.d. element; MMSE crossing property; MMSE matrix; Shannon vector entropy power inequality; broadcast channel; channel matrix; channel output estimation; eigenvalue; estimation theory; identity matrix; information theoretic property; input per-antenna power covariance constraint; minimum mean square error; mutual information; parallel random vector additive Gaussian channel; scalar additive Gaussian noise channel; signal-to-noise ratio; single crossing point property; Additives; Channel estimation; Covariance matrix; Gaussian noise; MIMO; Standards; Vectors; Entropy power inequality (EPI); Gaussian broadcast channel; Gaussian compound broadcast channel; Gaussian noise; I-MMSE; minimum mean square error (MMSE); multiple- input multiple-output (MIMO); mutual information; parallel vector channel; single crossing point;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2012.2225405