DocumentCode
257704
Title
Performance of parallel two-pass MDL context tree algorithm
Author
Krishnan, Nikhil ; Baron, Dror
Author_Institution
Dept. of Electr. & Comput. Eng., North Carolina State Univ., Raleigh, NC, USA
fYear
2014
fDate
3-5 Dec. 2014
Firstpage
331
Lastpage
335
Abstract
Computing problems that handle large amounts of data necessitate the use of lossless data compression for efficient storage and transmission. We present numerical results that showcase the advantages of a novel lossless universal data compression algorithm that uses parallel computational units to increase the throughput with minimal degradation in the compression quality. Our approach is to divide the data into blocks, estimate the minimum description length (MDL) context tree source underlying the entire input, and compress each block in parallel based on the MDL source. Numerical results from a prototype implementation suggest that our algorithm offers a better trade-off between compression and throughput than competing universal data compression algorithms.
Keywords
data compression; parallel algorithms; MDL context tree source; compression quality; data storage; data transmission; lossless universal data compression algorithm; minimum description length; parallel computational units; parallel two-pass MDL context tree algorithm; Big data; Context; Data compression; Decoding; Encoding; Redundancy; Throughput; big data; distributed computing; minimum description length; parallel algorithms; redundancy; two-pass code; universal data compression;
fLanguage
English
Publisher
ieee
Conference_Titel
Signal and Information Processing (GlobalSIP), 2014 IEEE Global Conference on
Conference_Location
Atlanta, GA
Type
conf
DOI
10.1109/GlobalSIP.2014.7032133
Filename
7032133
Link To Document