Title :
Toward a source coding theory for sets
Author :
Varshney, Lav R. ; Goyal, Vivek K.
Author_Institution :
Res. Lab. of Electron., MIT, Cambridge, MA, USA
Abstract :
The problem of communicating (unordered) sets, rather than (ordered) sequences is formulated. Elementary results in all major branches of source coding theory, including lossless coding, high-rate and low-rate quantization, and rate distortion theory are presented. In certain scenarios, rate savings of log n! bits for sets of size n are obtained. Asymptotically in the set size, the entropy rate is zero and for sources with an ordered parent alphabet, the (0,0) point is the rate distortion function.
Keywords :
entropy; rate distortion theory; set theory; source coding; communicating sets; entropy rate; high-rate quantization; lossless coding; low-rate quantization; ordered parent alphabet; rate distortion theory; set theory; source coding; Distortion measurement; Entropy; Information theory; Quantization; Random variables; Rate distortion theory; Size measurement; Source coding; Statistics; Uncertainty;
Conference_Titel :
Data Compression Conference, 2006. DCC 2006. Proceedings
Print_ISBN :
0-7695-2545-8
DOI :
10.1109/DCC.2006.78
