• DocumentCode
    4514
  • Title

    Chain Rules for Smooth Min- and Max-Entropies

  • Author

    Vitanov, A. ; Dupuis, Frederic ; Tomamichel, Marco ; Renner, Renato

  • Author_Institution
    Dept. of Math., ETH Zurich, Zurich, Switzerland
  • Volume
    59
  • Issue
    5
  • fYear
    2013
  • fDate
    May-13
  • Firstpage
    2603
  • Lastpage
    2612
  • Abstract
    The chain rule for the Shannon and von Neumann entropy, which relates the total entropy of a system to the entropies of its parts, is of central importance to information theory. Here, we consider the chain rule for the more general smooth min- and max-entropies, used in one-shot information theory. For these entropy measures, the chain rule no longer holds as an equality. However, the standard chain rule for the von Neumann entropy is retrieved asymptotically when evaluating the smooth entropies for many identical and independently distributed states.
  • Keywords
    entropy; Shannon entropy; chain rule; one-shot information theory; smooth max-entropy; smooth min-entropy; von Neumann entropy; Entropy; Hilbert space; Information theory; Integrated circuits; Optimization; Smoothing methods; Upper bound; Chain rules; one-shot information theory; smooth entropy;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2013.2238656
  • Filename
    6408179