DocumentCode
923910
Title
A conditional entropy bound for a pair of discrete random variables
Author
Witsenhausen, Hans S. ; Wyner, Aaron D.
Volume
21
Issue
5
fYear
1975
fDate
9/1/1975 12:00:00 AM
Firstpage
493
Lastpage
501
Abstract
Let 
be a pair of discrete random variables with a given joint probability distribution. For 
, the entropy of 
, define the function 
as the infimum of 
, the conditional entropy of 
given 
, with respect to all discrete random variables such that a) 
, and b) and are conditionally independent given . This paper concerns the function 
, its properties, its calculation, and its applications to several problems in information theory.
be a pair of discrete random variables with a given joint probability distribution. For , the entropy of , define the function as the infimum of , the conditional entropy of given , with respect to all discrete random variables such that a) , and b) and are conditionally independent given . This paper concerns the function , its properties, its calculation, and its applications to several problems in information theory.Keywords
Entropy functions; Random variables; Entropy; Information theory; Probability distribution; Random variables; Stochastic processes; Writing;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1975.1055437
Filename
1055437
Link To Document