• DocumentCode
    3502899
  • Title

    Coding theorems on the worst-case redundancy of fixed-length coding for a general source

  • Author

    Koga, Hiroki ; Arimura, Mitsuharu ; Iwata, Ken-ichi

  • Author_Institution
    Grad. Sch. of Syst. & Inf. Eng., Univ. of Tsukuba, Tsukuba, Japan
  • fYear
    2011
  • fDate
    July 31 2011-Aug. 5 2011
  • Firstpage
    1327
  • Lastpage
    1331
  • Abstract
    We consider a situation where n-tuples generated from a general source are encoded by a fixed-length code and discuss coding theorems on the worst-case redundancy, where the worst-case redundancy is defined as the maximum of the difference between the rate and the ideal codeword length per symbol with respect to all the correctly decodable n-tuples. We treat the four cases where the decoding error probability εn is required to satisfy (a) limn→∞ εn = 0, (b) lim infn→∞ εn = 0, (c) lim supn→∞ εn ≤ ε, and (d) lim infn→∞ εn ≤ ε, respectively, where ε ∈ [0; 1) is an arbitrary constant. We give general formulas of the optimum worst-case redundancy that are closely related to the width of the entropy-spectrum of a source.
  • Keywords
    decoding; entropy codes; error statistics; source coding; arbitrary constant; coding theorem; decodable n-tuple; decoding error probability; entropy-spectrum source; fixed-length coding; general source coding; ideal codeword length per symbol; optimum worst-case redundancy; Channel coding; Decoding; Error probability; Manganese; Redundancy; Source coding;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Proceedings (ISIT), 2011 IEEE International Symposium on
  • Conference_Location
    St. Petersburg
  • ISSN
    2157-8095
  • Print_ISBN
    978-1-4577-0596-0
  • Electronic_ISBN
    2157-8095
  • Type

    conf

  • DOI
    10.1109/ISIT.2011.6033753
  • Filename
    6033753