DocumentCode
923943
Title
Process definitions of distortion-rate functions and source coding theorems
Author
Gray, Robert M. ; Neuhoff, David L. ; Omura, Jim R.
Volume
21
Issue
5
fYear
1975
fDate
9/1/1975 12:00:00 AM
Firstpage
524
Lastpage
532
Abstract
The standard definition of the distortion-rate function involves a limit of information-tbeoretic minimizations over distributions of random vectors. Several alternative definitions, each involving a single minimization over random processes, are presented here and verified. These definitions parallel Khinchine´s process definition of channel capacity, provide a new interpretation of block and nonblock source coding (with a fidelity criterion) theorems in terms of optimal stochastic codes, and provide a comparison between the optimal performance theoretically attainable (OPTA) using block and nonblock source codes. Coupling the process definitions with recently developed bounding techniques provides a new and simple proof of the block source coding theorem for ergodic sources.
Keywords
Rate-distortion theory; Channel capacity; Constraint theory; Control engineering; Control engineering computing; Distortion measurement; Entropy; Military computing; Random processes; Source coding; Stochastic processes;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1975.1055440
Filename
1055440
Link To Document