DocumentCode :
257704
Title :
Performance of parallel two-pass MDL context tree algorithm
Author :
Krishnan, Nikhil ; Baron, Dror
Author_Institution :
Dept. of Electr. & Comput. Eng., North Carolina State Univ., Raleigh, NC, USA
fYear :
2014
fDate :
3-5 Dec. 2014
Firstpage :
331
Lastpage :
335
Abstract :
Computing problems that handle large amounts of data necessitate the use of lossless data compression for efficient storage and transmission. We present numerical results that showcase the advantages of a novel lossless universal data compression algorithm that uses parallel computational units to increase the throughput with minimal degradation in the compression quality. Our approach is to divide the data into blocks, estimate the minimum description length (MDL) context tree source underlying the entire input, and compress each block in parallel based on the MDL source. Numerical results from a prototype implementation suggest that our algorithm offers a better trade-off between compression and throughput than competing universal data compression algorithms.
Keywords :
data compression; parallel algorithms; MDL context tree source; compression quality; data storage; data transmission; lossless universal data compression algorithm; minimum description length; parallel computational units; parallel two-pass MDL context tree algorithm; Big data; Context; Data compression; Decoding; Encoding; Redundancy; Throughput; big data; distributed computing; minimum description length; parallel algorithms; redundancy; two-pass code; universal data compression;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Signal and Information Processing (GlobalSIP), 2014 IEEE Global Conference on
Conference_Location :
Atlanta, GA
Type :
conf
DOI :
10.1109/GlobalSIP.2014.7032133
Filename :
7032133
Link To Document :
بازگشت