• DocumentCode
    1485324
  • Title

    Successive refinement of information

  • Author

    Equitz, William H R ; Cover, Thomas M.

  • Author_Institution
    IBM Almaden Res. Center, San Jose, CA, USA
  • Volume
    37
  • Issue
    2
  • fYear
    1991
  • fDate
    3/1/1991 12:00:00 AM
  • Firstpage
    269
  • Lastpage
    275
  • Abstract
    The successive refinement of information consists of first approximating data using a few bits of information, then iteratively improving the approximation as more and more information is supplied. The goal is to achieve an optimal description at each stage. In general, an ongoing description which is rate-distortion optimal whenever it is interrupted is sought. It is shown that in order to achieve optimal successive refinement the necessary and sufficient conditions are that the solutions of the rate distortion problem can be written as a Markov chain. In particular, all finite alphabet signals with Hamming distortion satisfy these requirements. It is also shown that the same is true for Gaussian signals with squared error distortion and for Laplacian signals with absolute error distortion. A simple counterexample with absolute error distortion and a symmetric source distribution which shows that successive refinement is not always achievable is presented
  • Keywords
    information theory; Gaussian signals; Hamming distortion; Laplacian signals; absolute error distortion; finite alphabet signals; information theory; optimal description; rate distortion problem; squared error distortion; successive refinement; symmetric source distribution; Distortion; Gaussian distribution; Image coding; Information theory; Laplace equations; Propagation losses; Random variables; Rate-distortion; Statistics; Tree data structures;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.75242
  • Filename
    75242