• DocumentCode
    2018161
  • Title

    On a Construction of Entropic Vectors Using Lattice-Generated Distributions

  • Author

    Hassibi, B. ; Shadbakht, S.

  • Author_Institution
    California Inst. of Technol., Pasadena
  • fYear
    2007
  • fDate
    24-29 June 2007
  • Firstpage
    501
  • Lastpage
    505
  • Abstract
    The problem of determining the region of entropic vectors is a central one in information theory. There has been a great deal of interest in the development of non-Shannon information inequalities, which provide outer bounds to the aforementioned region; however, there has been less work on developing inner bounds. This paper develops an inner bound that applies to any number of random variables and which is tight for 2 and 3 random variables (the only cases where the entropy region is known). The construction is based on probability distributions generated by a lattice. The region is shown to be a polytope generated by a set of linear inequalities. Study of the region for 4 and more random variables is currently under investigation.
  • Keywords
    entropy; lattice theory; statistical distributions; vectors; entropic vector construction; information theory; lattice-generated distributions; linear inequalities; nonShannon information inequalities; probability distributions; Codes; Cramer-Rao bounds; Entropy; Information theory; Mutual information; Random variables; Vectors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 2007. ISIT 2007. IEEE International Symposium on
  • Conference_Location
    Nice
  • Print_ISBN
    978-1-4244-1397-3
  • Type

    conf

  • DOI
    10.1109/ISIT.2007.4557096
  • Filename
    4557096