Title :
On the connections between information and estimation theory: from AWGN Channels to dynamical systems with feedback
Author :
Piera, Francisco J. ; Parada, Patricio
Author_Institution :
Dept. of Electr. Eng., Univ. of Chile, Santiago
fDate :
Jan. 27 2008-Feb. 1 2008
Abstract :
We consider a stochastic dynamical system whose output evolves in time as the solution to a functional coefficients, Itopsilas stochastic differential equation, excited by an input process. This general class of stochastic systems encompasses a wide variety of engineering models appearing through a whole range of applications, extending in particular the classical communication channel models. We find analogous of known relationships linking input-output mutual information and causal and noncausal minimum mean-square errors in the context of additive Gaussian noise communication channels. The introduction in this general framework of an appropriate signal-to-noise ratio notion expressed through a signal-to-noise ratio parameter is also taken into account, identifying conditions for a proper and meaningful interpretation.
Keywords :
AWGN channels; channel estimation; feedback; least mean squares methods; stochastic processes; AWGN channels; additive Gaussian noise communication channels; classical communication channel models; estimation theory; feedback; information theory; minimum mean-square errors; stochastic differential equation; stochastic dynamical system; AWGN channels; Communication channels; Context; Differential equations; Estimation theory; Feedback; Joining processes; Mutual information; Signal to noise ratio; Stochastic systems;
Conference_Titel :
Information Theory and Applications Workshop, 2008
Conference_Location :
San Diego, CA
Print_ISBN :
978-1-4244-2670-6
DOI :
10.1109/ITA.2008.4601056