• DocumentCode
    1216902
  • Title

    On the asymptotic redundancy of lossless block coding with two codeword lengths

  • Author

    Figueroa, Enrique ; Houdré, Christian

  • Author_Institution
    Dept. of Math., Purdue Univ., West Lafayette, IN, USA
  • Volume
    51
  • Issue
    2
  • fYear
    2005
  • Firstpage
    688
  • Lastpage
    692
  • Abstract
    With the additional constraint of requiring only two codeword lengths, lossless codes of blocks of size n generated by stationary memoryless binary sources are studied. For arbitrary δ>0, classical large-deviation inequalities imply the existence of codes attaining an expected redundancy of the order O(n-12+δ/). It is shown that it is not possible to construct lossless codes with two codeword lengths having rate of order better or equal to O(n-12/).
  • Keywords
    block codes; redundancy; Chernoff-Hoeffding inequalities; Shannon theory; asymptotic redundancy; classical large-deviation inequalities; codeword lengths; lossless block coding; stationary memoryless binary sources; Block codes; Convergence; Decoding; Distribution functions; Entropy; Estimation theory; Mathematics; Random variables;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2004.840858
  • Filename
    1386537