• DocumentCode
    2265640
  • Title

    Conservation of mutual and directed information

  • Author

    Massey, James L. ; Massey, Peter C.

  • Author_Institution
    Lund Univ., Copenhagen
  • fYear
    2005
  • fDate
    4-9 Sept. 2005
  • Firstpage
    157
  • Lastpage
    158
  • Abstract
    Two conservation laws for mutual information in terms of directed informations between two synchronized sequences of random variables are derived, the first for the case of no conditioning and the second for the case of causal conditioning on a third synchronized sequence. As a byproduct of the derivation of the first conservation law, the directed information specifying the feedback flowing from the second sequence to the first sequence is identified, which leads to a simple proof that a previously known sufficient condition for equality of mutual and directed information is also a necessary condition
  • Keywords
    causality; information theory; random functions; causal conditioning; conservation law; directed informations; random variables; synchronized sequences; Clocks; Delay effects; Entropy; Equations; Feedback; Mutual information; Random variables; Sufficient conditions; Synchronization;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 2005. ISIT 2005. Proceedings. International Symposium on
  • Conference_Location
    Adelaide, SA
  • Print_ISBN
    0-7803-9151-9
  • Type

    conf

  • DOI
    10.1109/ISIT.2005.1523313
  • Filename
    1523313