DocumentCode
266087
Title
Rényi entropy dimension of the mixture of measures
Author
Smieja, Marek ; Tabor, Jacek
Author_Institution
Fac. of Math. & Comput. Sci., Jagiellonian Univ., Kraków, Poland
fYear
2014
fDate
27-29 Aug. 2014
Firstpage
685
Lastpage
689
Abstract
Rényi entropy dimension describes the rate of growth of coding cost in the process of lossy data compression in the case of exponential dependence between the code length and the cost of coding. In this paper we generalize the Csiszár estimation of the Rényi entropy dimension of the mixture of measures for the case of general probability metric space. This result determines the cost of encoding of the information which comes from the combined sources assuming its exponential growth. Our proof relies on an equivalent definition of the Rényi entropy in weighted form which allows to deal well with a calculation of the entropy of the mixture of measures.
Keywords
data compression; encoding; entropy; estimation theory; probability; Csiszár estimation; Rényi entropy dimension; code length; coding cost; combined sources; exponential dependence; general probability metric space; lossy data compression; mixture of measures; Channel coding; Entropy; Estimation; Extraterrestrial measurements; Weight measurement; Rényi entropy; Rényi entropy dimension; coding; weighted entropy;
fLanguage
English
Publisher
ieee
Conference_Titel
Science and Information Conference (SAI), 2014
Conference_Location
London
Print_ISBN
978-0-9893-1933-1
Type
conf
DOI
10.1109/SAI.2014.6918261
Filename
6918261
Link To Document