DocumentCode
1315998
Title
Tunstall adaptive coding and miscoding
Author
Fabris, Francesco ; Sgarro, Andrea ; Pauletti, Rudy
Author_Institution
Dipartimento di Matematica e Inf., Udine Univ., Italy
Volume
42
Issue
6
fYear
1996
fDate
11/1/1996 12:00:00 AM
Firstpage
2167
Lastpage
2180
Abstract
In the first part of this paper, we tackle the case where a variable length-to-block Tunstall code is used to encode the wrong source (miscoding). It turns out that, exactly as happens in the case with Huffman coding, the asymptotic excess rate is given by the informational divergence between the probability distribution ruling the source and the probability distribution for which the Tunstall code had been devised. We also prove asymptotic equality between the individual rate of a codeword and the corresponding self-information. This allows us to bound the maximal and the minimal length in a Tunstall tree. In the second part of the paper we study the case where the probability distribution of the source changes in time. If this happens, it is necessary to frequently update the current code, to ensure that the optimality conditions concerning its rate are met. This coding procedure is known as adaptive coding. We propose some schemes for adaptive Tunstall coding, based on the structure of the coding tree, on the “ordering property”, analogous to Gallager´s (1978) sibling property of the Huffman code, and on the “Tunstall regions”, analogous to the attraction regions due to Longo and Galasso (1982)
Keywords
adaptive codes; block codes; probability; source coding; variable length codes; Tunstall adaptive coding; Tunstall regions; Tunstall tree; adaptive coding; asymptotic equality; asymptotic excess rate; coding procedure; individual rate; informational divergence; maximal length; minimal length; miscoding; optimality conditions; ordering property; probability distribution; self-information; variable length-to-block Tunstall code; Adaptive coding; Entropy; Huffman coding; Probability distribution;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.556605
Filename
556605
Link To Document