• DocumentCode
    1330857
  • Title

    On the AEP of word-valued sources

  • Author

    Nishiara, Mikihiko ; Morita, Hiroyoshi

  • Author_Institution
    Graduate Sch. of Inf. Syst., Univ. of Electro-Commun., Tokyo, Japan
  • Volume
    46
  • Issue
    3
  • fYear
    2000
  • fDate
    5/1/2000 12:00:00 AM
  • Firstpage
    1116
  • Lastpage
    1120
  • Abstract
    We consider a new class of information sources called word-valued sources in order to investigate coding algorithms based upon string parsing. A word-valued source is defined as a pair of an independent and identically distributed (i.i.d.) source with a countable alphabet and a function that maps each symbol into a finite sequence over a finite alphabet. A word-valued source is a nonstationary process and has countable states. If the function of a word-valued source is prefix-free, the entropy rate is characterized with a simple expression and the AEP (asymptotic equipartition property) holds
  • Keywords
    entropy; grammars; probability; sequences; source coding; AEP; asymptotic equipartition property; coding algorithms; compressed sequence; countable alphabet; countable states; entropy rate; finite alphabet; finite sequence; i.i.d. source; independent identically distributed source; information sources; nonstationary process; probability distribution; string parsing; word-valued source; word-valued sources; Adaptive coding; Arithmetic; Data compression; Entropy; Frequency estimation; Information systems; Probability distribution; Production; Source coding; Statistical distributions;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.841193
  • Filename
    841193