Title :
Context-dependent vs. context-free: performance comparison of grammar-based codes
Author :
Yang, En-Hui ; He, Da-Ke
Author_Institution :
Dept. of Electr. & Comput. Eng., Waterloo Univ., Ont., Canada
fDate :
29 June-4 July 2003
Abstract :
In this paper, we compare the performance of two types of universal data compression algorithms: context-dependent grammar-based (CDG-based) codes and context-free grammar-based (CFG-based) codes. The theoretical comparison of two algorithm is complicated by the following two facts observed: 1) Both CDG-based codes and CFG-based codes are universal for the class of stationary, ergodic sources with a finite alphabet; and 2) When the number of distinct contexts is upper bounded by a fixed number, the upper bounds on worst-case redundancy of CDG-based codes and CFG-based codes against any finite context arithmetic codes are in the same order of O(log log n/ log n). previously, two universal algorithms were compared only on the basis of some individual sequences. It was shown that for any sequential lossless code that is performable on a computer, there exists a sequence that is not compressible by the given code.
Keywords :
arithmetic codes; context-free grammars; data compression; context-dependent grammar-based code; context-free grammar-based codes; ergodic sources; finite alphabet; finite context arithmetic code; universal data compression algorithms; Arithmetic; Binary sequences; Compression algorithms; Context modeling; Councils; Data compression; Entropy; Information technology; Technological innovation; Upper bound;
Conference_Titel :
Information Theory, 2003. Proceedings. IEEE International Symposium on
Print_ISBN :
0-7803-7728-1
DOI :
10.1109/ISIT.2003.1228065