Title :
Channel simulation and coding with side information
Author :
Steinberg, Yossef ; Verdu, Sergio
Author_Institution :
Dept. of Electr. Eng., Princeton Univ., NJ, USA
fDate :
5/1/1994 12:00:00 AM
Abstract :
Studies the minimum random bit rate required to simulate a random system (channel), where the simulator operates with a given external input. As measures of simulation accuracy the authors use both the variational distance and the d¯ distance between joint input-output distributions. They find the asymptotic number of random bits per input sample required for accurate simulation, as a function of the distribution of the input process. These results hold for arbitrary channels and input processes, including nonstationary and nonergodic processes and do not hinge on a specific simulation scheme. A by-product of the analysis is a general formula for the minimal achievable source coding rate with side information
Keywords :
digital simulation; encoding; entropy; random processes; telecommunication channels; asymptotic number of random bits per input sample; channel simulation; coding; input process; joint input-output distributions; minimal achievable source coding rate; minimum random bit rate; nonergodic processes; nonstationary processes; random system; side information; simulation accuracy; variational distance; Bit rate; Channel coding; Fasteners; Information analysis; Information theory; Joining materials; Probability distribution; Source coding; Speech; Statistics;
Journal_Title :
Information Theory, IEEE Transactions on