Title :
Some Upper Bounds on the Redundancy of Optimal Binary Fix-Free Codes
Author :
Khosravifard, Mohammadali ; Kheradmand, Shima
Author_Institution :
Dept. of Electr. & Comput. Eng., Isfahan Univ. of Technol., Isfahan, Iran
fDate :
6/1/2012 12:00:00 AM
Abstract :
In order to investigate the cost of employing fix-free codes instead of the well-established prefix-free codes, some upper bounds on the redundancy of the optimal fix-free codes and their difference with the corresponding Huffman codes are presented. Unlike the conventional approach, which is based on some Shannon-like suboptimal codes, we examine the redundancy of a better Huffman-like code. An algorithm is proposed for deriving optimal binary codeword lengths with Kraft-sum [5/8] for a given probability distribution. The existence of a fix-free code with such codelengths is guaranteed by Yekhanin´s theorem. It is shown that the redundancy of this fix-free code is, at most, 0.8 bit greater than that of the Huffman code and does not exceed [8/3]-log3 ≅ 1.0817 bits. This upper bound is [4/3]-log[5/3] ≅0.5964 bit less than the best known one. If the [3/4]-conjecture is proved sometime in the future, the presented upper bound on the redundancy of the optimal fix-free codes (i.e., 1.0817) will be improved by only [5/3]-log3 ≅ 0.0817 . In addition to these general bounds, all known upper bounds in terms of the largest, the smallest, and an arbitrary given symbol probability are substantially improved.
Keywords :
Huffman codes; binary codes; redundancy; statistical distributions; Huffman codes; Kraft-sum; Shannon-like suboptimal codes; Yekhanin theorem; binary codeword lengths; optimal binary fix-free codes redundancy; prefix-free codes; probability distribution; symbol probability; Context; Decoding; Probability distribution; Radio frequency; Redundancy; Upper bound; Vectors; ${{3}over{4}}$-Conjecture; Kraft-sum; Yekhanin\´s theorem; optimal fix-free code; redundancy;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2012.2189433