• DocumentCode
    3505772
  • Title

    Further results on geometric properties of a family of relative entropies

  • Author

    Moses, Ashok Kumar ; Sundaresan, Rajesh

  • Author_Institution
    Dept. of ECE, Indian Inst. of Sci., Bangalore, India
  • fYear
    2011
  • fDate
    July 31 2011-Aug. 5 2011
  • Firstpage
    1940
  • Lastpage
    1944
  • Abstract
    This paper extends some geometric properties of a one-parameter family of relative entropies. These arise as redundancies when cumulants of compressed lengths are considered instead of expected compressed lengths. These parametric relative entropies are a generalization of the Kullback-Leibler divergence. They satisfy the Pythagorean property and behave like squared distances. This property, which was known for finite alphabet spaces, is now extended for general measure spaces. Existence of projections onto convex and certain closed sets is also established. Our results may have applications in the Rényi entropy maximization rule of statistical physics.
  • Keywords
    entropy; 2011; Kullback-Leibler divergence; Pythagorean property; Renyi entropy maximization rule; entropy geometric property; finite alphabet space property; one-parameter relative entropy family; squared distance property; statistical physics; Atmospheric measurements; Entropy; Extraterrestrial measurements; Particle measurements; Q measurement; Redundancy;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Proceedings (ISIT), 2011 IEEE International Symposium on
  • Conference_Location
    St. Petersburg
  • ISSN
    2157-8095
  • Print_ISBN
    978-1-4577-0596-0
  • Electronic_ISBN
    2157-8095
  • Type

    conf

  • DOI
    10.1109/ISIT.2011.6033890
  • Filename
    6033890