• DocumentCode
    257704
  • Title

    Performance of parallel two-pass MDL context tree algorithm

  • Author

    Krishnan, Nikhil ; Baron, Dror

  • Author_Institution
    Dept. of Electr. & Comput. Eng., North Carolina State Univ., Raleigh, NC, USA
  • fYear
    2014
  • fDate
    3-5 Dec. 2014
  • Firstpage
    331
  • Lastpage
    335
  • Abstract
    Computing problems that handle large amounts of data necessitate the use of lossless data compression for efficient storage and transmission. We present numerical results that showcase the advantages of a novel lossless universal data compression algorithm that uses parallel computational units to increase the throughput with minimal degradation in the compression quality. Our approach is to divide the data into blocks, estimate the minimum description length (MDL) context tree source underlying the entire input, and compress each block in parallel based on the MDL source. Numerical results from a prototype implementation suggest that our algorithm offers a better trade-off between compression and throughput than competing universal data compression algorithms.
  • Keywords
    data compression; parallel algorithms; MDL context tree source; compression quality; data storage; data transmission; lossless universal data compression algorithm; minimum description length; parallel computational units; parallel two-pass MDL context tree algorithm; Big data; Context; Data compression; Decoding; Encoding; Redundancy; Throughput; big data; distributed computing; minimum description length; parallel algorithms; redundancy; two-pass code; universal data compression;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Signal and Information Processing (GlobalSIP), 2014 IEEE Global Conference on
  • Conference_Location
    Atlanta, GA
  • Type

    conf

  • DOI
    10.1109/GlobalSIP.2014.7032133
  • Filename
    7032133