DocumentCode
2265640
Title
Conservation of mutual and directed information
Author
Massey, James L. ; Massey, Peter C.
Author_Institution
Lund Univ., Copenhagen
fYear
2005
fDate
4-9 Sept. 2005
Firstpage
157
Lastpage
158
Abstract
Two conservation laws for mutual information in terms of directed informations between two synchronized sequences of random variables are derived, the first for the case of no conditioning and the second for the case of causal conditioning on a third synchronized sequence. As a byproduct of the derivation of the first conservation law, the directed information specifying the feedback flowing from the second sequence to the first sequence is identified, which leads to a simple proof that a previously known sufficient condition for equality of mutual and directed information is also a necessary condition
Keywords
causality; information theory; random functions; causal conditioning; conservation law; directed informations; random variables; synchronized sequences; Clocks; Delay effects; Entropy; Equations; Feedback; Mutual information; Random variables; Sufficient conditions; Synchronization;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory, 2005. ISIT 2005. Proceedings. International Symposium on
Conference_Location
Adelaide, SA
Print_ISBN
0-7803-9151-9
Type
conf
DOI
10.1109/ISIT.2005.1523313
Filename
1523313
Link To Document