Title :
Guessing Under Source Uncertainty
Author :
Sundaresan, Rajesh
Author_Institution :
Dept. of Electr. Commun. Eng., Indian Inst. of Sci., Bangalore
Abstract :
This paper considers the problem of guessing the realization of a finite alphabet source when some side information is provided. The only knowledge the guesser has about the source and the correlated side information is that the joint source is one among a family. A notion of redundancy is first defined and a new divergence quantity that measures this redundancy is identified. This divergence quantity shares the Pythagorean property with the Kullback-Leibler divergence. Good guessing strategies that minimize the supremum redundancy (over the family) are then identified. The min-sup value measures the richness of the uncertainty set. The min-sup redundancies for two examples - the families of discrete memoryless sources and finite-state arbitrarily varying sources - are then determined
Keywords :
correlation theory; redundancy; Kullback-Leibler divergence; Pythagorean property; correlated side information; divergence quantity; guessing; information correlation; redundancy minimization; source uncertainty; Cryptography; Entropy; Humans; Information geometry; Information theory; Performance analysis; Random variables; Uncertainty; Upper bound; $f$-divergence; $I$-projection; Pythagorean identity; Rényi entropy; Rényi information divergence; guessing; information geometry; mismatch; redundancy; side information;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2006.887466