Title :
Lautum Information
Author :
Palomar, Daniel P. ; Verdú, Sergio
Author_Institution :
Dept. of Electron. & Comput. Eng., Hong Kong Univ. of Sci. & Technol., Kowloon
fDate :
3/1/2008 12:00:00 AM
Abstract :
A popular way to measure the degree of dependence between two random objects is by their mutual information, defined as the divergence between the joint and product-of-marginal distributions. We investigate an alternative measure of dependence: the lautum information defined as the divergence between the product-of-marginal and joint distributions, i.e., swapping the arguments in the definition of mutual information. Some operational characterizations and properties are provided for this alternative measure of information.
Keywords :
information theory; lautum information; mutual information; Artificial intelligence; Authentication; Biomedical imaging; Collaborative work; Genetic communication; Government; Information theory; Machine learning; Mutual information; Testing; Divergence; Kelly gambling; hypothesis testing; information measures; mutual information;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2007.915715