Title :
Folklore in source coding: information-spectrum approach
Author_Institution :
Graduate Sch. of Inf. Syst., Univ. of Electro-Commun., Tokyo
Abstract :
Information theory has several traditional folklore problems about data compression or channel coding with reference to random number generation problems. Here, we focus on and reasonably formulate one of them from the viewpoint of information spectra. Specifically, we verify the validity of the folklore that the output from any source encoder working at the optimal coding rate with asymptotically vanishing probability of error looks like almost completely random
Keywords :
channel coding; data compression; error statistics; random number generation; source coding; channel coding; data compression; error probability; folklore; information-spectrum theory; optimal coding rate; random number generation; source coding; Channel coding; Data compression; Decoding; Information systems; Probability distribution; Random number generation; Random variables; Source coding; Sun; Tellurium; Almost completely random; data compression; folklore; information spectrum; intrinsic randomness; random number generation;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2004.840860
