• DocumentCode
    266087
  • Title

    Rényi entropy dimension of the mixture of measures

  • Author

    Smieja, Marek ; Tabor, Jacek

  • Author_Institution
    Fac. of Math. & Comput. Sci., Jagiellonian Univ., Kraków, Poland
  • fYear
    2014
  • fDate
    27-29 Aug. 2014
  • Firstpage
    685
  • Lastpage
    689
  • Abstract
    Rényi entropy dimension describes the rate of growth of coding cost in the process of lossy data compression in the case of exponential dependence between the code length and the cost of coding. In this paper we generalize the Csiszár estimation of the Rényi entropy dimension of the mixture of measures for the case of general probability metric space. This result determines the cost of encoding of the information which comes from the combined sources assuming its exponential growth. Our proof relies on an equivalent definition of the Rényi entropy in weighted form which allows to deal well with a calculation of the entropy of the mixture of measures.
  • Keywords
    data compression; encoding; entropy; estimation theory; probability; Csiszár estimation; Rényi entropy dimension; code length; coding cost; combined sources; exponential dependence; general probability metric space; lossy data compression; mixture of measures; Channel coding; Entropy; Estimation; Extraterrestrial measurements; Weight measurement; Rényi entropy; Rényi entropy dimension; coding; weighted entropy;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Science and Information Conference (SAI), 2014
  • Conference_Location
    London
  • Print_ISBN
    978-0-9893-1933-1
  • Type

    conf

  • DOI
    10.1109/SAI.2014.6918261
  • Filename
    6918261