• DocumentCode
    2988442
  • Title

    Tsallis differential entropy and divergences derived from the generalized Shannon-Khinchin axioms

  • Author

    Suyari, Hiroki ; Tsukada, Makoto

  • Author_Institution
    Dept. of Inf. Sci., Toho Univ., Funabashi, Japan
  • fYear
    2009
  • fDate
    June 28 2009-July 3 2009
  • Firstpage
    149
  • Lastpage
    153
  • Abstract
    In discrete systems, Shannon entropy is well known to be characterized by the Shannon-Khinchin axioms. Recently, this set of axioms was generalized for Tsallis entropy, one-parameter generalization of Shannon entropy. In continuous systems, Shannon differential entropy has been introduced as a natural extension of the above Shannon entropy without using an axiomatic approach. We derive the generalized entropy function as a solution of the functional equation determined by the generalized Shannon additivity, one of the most important axiom of the generalized Shannon-Khinchin axioms for Tsallis entropy. This generalized entropy function naturally introduces Tsallis differential entropy and two Tsallis divergences. In particular, one (Csisza¿r type) of the divergences has almost the same form as the ¿-divergence in information geometry and the other the Bregman type divergence. Our results reveal that the generalized Shannon additivity representing a branch structure of a rooted tree plays an essential role in the determination of these entropies.
  • Keywords
    continuous systems; discrete systems; entropy; functional equations; Bregman type divergence; Shannon differential entropy; Tsallis differential entropy; Tsallis divergences; continuous system; discrete system; functional equation; generalized Shannon-Khinchin axiom; information geometry; one-parameter generalization; ¿-divergence; Concrete; Differential equations; Entropy; Fractals; Information geometry; Information science; Particle measurements; Physics; Q measurement; Statistics; α-divergence; Bregman divergence; Tsallis differential entropy; generalized Shannon additivity; generalized Shannon-Khinchin axioms; rooted tree;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 2009. ISIT 2009. IEEE International Symposium on
  • Conference_Location
    Seoul
  • Print_ISBN
    978-1-4244-4312-3
  • Electronic_ISBN
    978-1-4244-4313-0
  • Type

    conf

  • DOI
    10.1109/ISIT.2009.5205861
  • Filename
    5205861