• DocumentCode
    752176
  • Title

    Universal codes for finite sequences of integers drawn from a monotone distribution

  • Author

    Foster, Dean P. ; Stine, Robert A. ; Wyner, Abraham J.

  • Author_Institution
    Wharton Sch., Pennsylvania Univ., Philadelphia, PA, USA
  • Volume
    48
  • Issue
    6
  • fYear
    2002
  • fDate
    6/1/2002 12:00:00 AM
  • Firstpage
    1713
  • Lastpage
    1720
  • Abstract
    We offer two noiseless codes for blocks of integers Xn = (X1, ..., Xn). We provide explicit bounds on the relative redundancy that are valid for any distribution F in the class of memoryless sources with a possibly infinite alphabet whose marginal distribution is monotone. Specifically, we show that the expected code length L (Xn) of our first universal code is dominated by a linear function of the entropy of Xn. Further, we present a second universal code that is efficient in that its length is bounded by nHF + o(nHF), where HF is the entropy of F which is allowed to vary with n. Since these bounds hold for any n and any monotone F we are able to show that our codes are strongly minimax with respect to relative redundancy (as defined by Elias (1975)). Our proofs make use of the elegant inequality due to Aaron Wyner (1972)
  • Keywords
    codes; entropy; memoryless systems; sequences; statistical analysis; code length; elegant inequality; entropy; explicit bounds; finite sequences; infinite alphabet; linear function; memoryless sources; minimax code; monotone marginal distribution; noiseless codes; relative redundancy; universal codes; Codes; Control systems; Estimation theory; Hidden Markov models; Information theory; Memoryless systems; Notice of Violation; Stochastic processes; Testing; World Wide Web;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2002.1003851
  • Filename
    1003851