DocumentCode
2988442
Title
Tsallis differential entropy and divergences derived from the generalized Shannon-Khinchin axioms
Author
Suyari, Hiroki ; Tsukada, Makoto
Author_Institution
Dept. of Inf. Sci., Toho Univ., Funabashi, Japan
fYear
2009
fDate
June 28 2009-July 3 2009
Firstpage
149
Lastpage
153
Abstract
In discrete systems, Shannon entropy is well known to be characterized by the Shannon-Khinchin axioms. Recently, this set of axioms was generalized for Tsallis entropy, one-parameter generalization of Shannon entropy. In continuous systems, Shannon differential entropy has been introduced as a natural extension of the above Shannon entropy without using an axiomatic approach. We derive the generalized entropy function as a solution of the functional equation determined by the generalized Shannon additivity, one of the most important axiom of the generalized Shannon-Khinchin axioms for Tsallis entropy. This generalized entropy function naturally introduces Tsallis differential entropy and two Tsallis divergences. In particular, one (Csisza¿r type) of the divergences has almost the same form as the ¿-divergence in information geometry and the other the Bregman type divergence. Our results reveal that the generalized Shannon additivity representing a branch structure of a rooted tree plays an essential role in the determination of these entropies.
Keywords
continuous systems; discrete systems; entropy; functional equations; Bregman type divergence; Shannon differential entropy; Tsallis differential entropy; Tsallis divergences; continuous system; discrete system; functional equation; generalized Shannon-Khinchin axiom; information geometry; one-parameter generalization; ¿-divergence; Concrete; Differential equations; Entropy; Fractals; Information geometry; Information science; Particle measurements; Physics; Q measurement; Statistics; α-divergence; Bregman divergence; Tsallis differential entropy; generalized Shannon additivity; generalized Shannon-Khinchin axioms; rooted tree;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory, 2009. ISIT 2009. IEEE International Symposium on
Conference_Location
Seoul
Print_ISBN
978-1-4244-4312-3
Electronic_ISBN
978-1-4244-4313-0
Type
conf
DOI
10.1109/ISIT.2009.5205861
Filename
5205861
Link To Document