Title :
Performance analysis of Fano coding
Author :
Stanislav Krajci; Chin-Fu Liu;Ladislav Mikes;Stefan M. Moser
Author_Institution :
Inst. of Comput. Sci., Pavol Jozef rafarik Univ., Kosice, Slovakia
fDate :
6/1/2015 12:00:00 AM
Abstract :
A rigorous performance analysis of Fano coding is presented, providing an upper bound on the average codeword length of binary and ternary Fano codes for an arbitrary discrete memoryless source. The performance bound is slightly better than Shannon´s well-known bound for Shannon coding. As a by-product a novel general lower bound on Shannon entropy is derived that might be of interest also in a different context. This bound is expressed with the help of variational distance and provides a special case of a reverse Pinsker inequality.
Keywords :
"Entropy","Channel coding","Redundancy","Upper bound","Random variables","Performance analysis"
Conference_Titel :
Information Theory (ISIT), 2015 IEEE International Symposium on
Electronic_ISBN :
2157-8117
DOI :
10.1109/ISIT.2015.7282755