• DocumentCode
    1367194
  • Title

    Guessing subject to distortion

  • Author

    Arikan, Erdal ; Merhav, Neri

  • Author_Institution
    Dept. of Electr. & Electron. Eng., Bilkent Univ., Ankara, Turkey
  • Volume
    44
  • Issue
    3
  • fYear
    1998
  • fDate
    5/1/1998 12:00:00 AM
  • Firstpage
    1041
  • Lastpage
    1056
  • Abstract
    We investigate the problem of guessing a random vector X within distortion level D. Our aim is to characterize the best attainable performance in the sense of minimizing, in some probabilistic sense, the number of required guesses G(X) until the error falls below D. The underlying motivation is that G(X) is the number of candidate codewords to be examined by a rate-distortion block encoder until a satisfactory codeword is found. In particular, for memoryless sources, we provide a single-letter characterization of the least achievable exponential growth rate of the ρth moment of G(X) as the dimension of the random vector X grows without bound. In this context, we propose an asymptotically optimal guessing scheme that is universal both with respect to the information source and the value of ρ. We then study some properties of the exponent function E(D, ρ) along with its relation to the source-coding exponents. Finally, we provide extensions of our main results to the Gaussian case, guessing with side information, and sources with memory
  • Keywords
    block codes; memoryless systems; minimisation; random processes; rate distortion theory; source coding; Gaussian case; asymptotically optimal guessing scheme; candidate codewords; error; exponent function; exponential growth rate; guessing; information source; memoryless sources; performance; probabilistic sense; random vector; rate-distortion block encoder; side information; single-letter characterization; source-coding exponents; Databases; Distortion measurement; Horses; Information theory; Laboratories; Probability distribution; Random variables; Rate-distortion; Search problems; Source coding;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.669158
  • Filename
    669158