• DocumentCode
    923943
  • Title

    Process definitions of distortion-rate functions and source coding theorems

  • Author

    Gray, Robert M. ; Neuhoff, David L. ; Omura, Jim R.

  • Volume
    21
  • Issue
    5
  • fYear
    1975
  • fDate
    9/1/1975 12:00:00 AM
  • Firstpage
    524
  • Lastpage
    532
  • Abstract
    The standard definition of the distortion-rate function involves a limit of information-tbeoretic minimizations over distributions of random vectors. Several alternative definitions, each involving a single minimization over random processes, are presented here and verified. These definitions parallel Khinchine´s process definition of channel capacity, provide a new interpretation of block and nonblock source coding (with a fidelity criterion) theorems in terms of optimal stochastic codes, and provide a comparison between the optimal performance theoretically attainable (OPTA) using block and nonblock source codes. Coupling the process definitions with recently developed bounding techniques provides a new and simple proof of the block source coding theorem for ergodic sources.
  • Keywords
    Rate-distortion theory; Channel capacity; Constraint theory; Control engineering; Control engineering computing; Distortion measurement; Entropy; Military computing; Random processes; Source coding; Stochastic processes;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.1975.1055440
  • Filename
    1055440