DocumentCode
911964
Title
An application of rate-distortion theory to a converse to the coding theorem
Author
Pinkston, John T.
Volume
15
Issue
1
fYear
1969
fDate
1/1/1969 12:00:00 AM
Firstpage
66
Lastpage
71
Abstract
A lower bound to the information rate
for a discrete memoryless source with a fidelity criterion is presented for the case in which the distortion matrix contains the same set of entries, perhaps permuted, in each column. A necessary and sufficient condition for
to equal this bound is given. In particular, if the smallest column element is zero and occurs once in each row, then there is a range of
, in which equality holds. These results are then applied to the special case of
, for which the average distortion is just the probability of incorrectly reproducing the source output. We show how to construct
for this case, from which one can solve for the minimum achievable probability of error when transmitting over a channel of known capacity.
for a discrete memoryless source with a fidelity criterion is presented for the case in which the distortion matrix contains the same set of entries, perhaps permuted, in each column. A necessary and sufficient condition for
to equal this bound is given. In particular, if the smallest column element is zero and occurs once in each row, then there is a range of
, in which equality holds. These results are then applied to the special case of
, for which the average distortion is just the probability of incorrectly reproducing the source output. We show how to construct
for this case, from which one can solve for the minimum achievable probability of error when transmitting over a channel of known capacity.Keywords
Rate-distortion theory; Channel capacity; Codes; Communication system control; Feedback; Information theory; Network address translation; Optimal control; Rate-distortion; Signal design; Uncertainty;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1969.1054274
Filename
1054274
Link To Document