• DocumentCode
    873130
  • Title

    Entropy and expected acceptance counts for finite automata

  • Author

    Pippenger, Nicholas

  • Author_Institution
    Dept. of Comput. Sci., Princeton Univ., NJ, USA
  • Volume
    50
  • Issue
    1
  • fYear
    2004
  • Firstpage
    78
  • Lastpage
    88
  • Abstract
    If a sequence of independent unbiased random bits is fed into a finite automaton, it is straightforward to calculate the expected number of acceptances among the first n prefixes of the sequence. This paper deals with the situation in which the random bits are neither independent nor unbiased, but are nearly so. We show that, under suitable assumptions concerning the automaton, if the difference between the entropy of the first n bits and n converges to a constant exponentially fast, then the change in the expected number of acceptances also converges to a constant exponentially fast. We illustrate this result with a variety of examples in which numbers following the reciprocal distribution, which governs the significands of floating-point numbers, are recoded in the execution of various multiplication algorithms.
  • Keywords
    entropy; finite automata; floating point arithmetic; statistical distributions; entropy; expected acceptance counts; finite automata; finite automaton; floating-point number significands; independent unbiased random bits; logarithmic distribution; multiplication algorithms; multiplier recoding; reciprocal distribution; Algorithm design and analysis; Automata; Computer science; Cryptography; Digital arithmetic; Entropy; Markov processes; Terminology;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2003.821997
  • Filename
    1262618