Title :
Variable-to-fixed length codes and the conservation of entropy
Author :
Savari, Serap A.
Author_Institution :
Comput. Principles Res. Dept., AT&T Bell Labs., Murray Hill, NJ, USA
fDate :
7/1/1999 12:00:00 AM
Abstract :
For a large class of parsing rules, we introduce a “conservation of entropy” theorem for the output of a unifilar Markov source. Using this theorem and renewal theory, we find a procedure to generate asymptotically optimal generalized variable-to-fixed length codes
Keywords :
Markov processes; entropy; variable length codes; asymptotically optimal generalized variable-to-fixed length codes; conservation; fixed length codes; parsing rules; renewal theory; unifilar Markov source; variable-length codes; Data compression; Dictionaries; Entropy; Information theory; Laboratories; Materials science and technology; Probability; Source coding;
Journal_Title :
Information Theory, IEEE Transactions on