Title :
The Source Coding Game With a Cheating Switcher
Author :
Palaiyanur, Hari ; Chang, Cheng ; Sahai, Anant
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Univ. of California at Berkeley, Berkeley, CA, USA
fDate :
7/1/2011 12:00:00 AM
Abstract :
The problem of finding the rate-distortion function of an arbitrarily varying source (AVS) composed of a finite number of memoryless subsources is revisited. Berger´s 1971 paper “The Source Coding Game” solves this problem when the adversary is allowed only strictly causal access to the subsource realizations. The case when the adversary has access to the subsource realizations non-causally is considered. This new rate-distortion function is determined to be the maximum of the rate-distortion function over a set of independent and identically distributed (IID) random variables that can be simulated by the adversary. The results are extended to allow for partial or noisy observations of subsource realizations. The model is further explored by attempting to find the rate-distortion function when the `adversary´ is actually helpful. Finally, a bound is developed on the uniform continuity of the IID rate-distortion function for finite-alphabet sources. The bound is used to give a sufficient number of distributions that need to be sampled to compute the rate-distortion function of an AVS to within a desired accuracy. The bound is also used to give a rate of convergence for the estimate of the rate-distortion function for an unknown IID source.
Keywords :
causality; random functions; rate distortion theory; source coding; telecommunication switching; AVS; IID random variable; arbitrarily varying source; causality; cheating switcher; finite-alphabet source; independent and identically distributed random variable; memoryless subsource finite number; rate-distortion function; source coding game; Distortion measurement; Games; Generators; Noise measurement; Rate-distortion; Source coding; Switches; Adversarial source coding; arbitrarily varying source; finite alphabet; rate-distortion; source coding game; type covering; uniform continuity of rate-distortion functions;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2011.2145730