Compression Speed Enhancements to LZO for Multi-core Systems

Author

Kane, Jason ; Yang, Qing

Author_Institution

Dept. of Electr., Comput. & Biomed. Eng., Univ. of Rhode Island, Kingston, RI, USA

fYear

2012

fDate

24-26 Oct. 2012

Firstpage

108

Lastpage

115

Abstract

This paper examines several promising throughput enhancements to the Lempel-Ziv-Oberhumer (LZO) 1x-1-15 data compression algorithm. Of many algorithm variants present in the current library version, 2.06, LZO 1x-1-15 is considered to be the fastest, geared toward speed rather than compression ratio. We present several algorithm modifications tailored to modern multi-core architectures in this paper that are intended to increase compression speed while minimizing any loss in compression ratio. On average, the experimental results show that on a modern quad core system, a 3.9x speedup in compression time is achieved over the baseline algorithm with no loss to compression ratio. Allowing for a 25% loss in compression ratio, up to a 5.4x speedup in compression time was observed.

Keywords

data compression; multiprocessing systems; LZO; Lempel-Ziv-Oberhumer 1x-1-15 data compression algorithm; compression speed enhancements; multicore architectures; multicore systems; quad core system; Data compression; Dictionaries; Hardware; Image coding; Instruction sets; Libraries; Lempel-Ziv-Oberhumer (LZO); Lossless Data Compression; Parallel Algorithms; Parallel Computing; Real-Time Systems;

fLanguage

English

Publisher

ieee

Conference_Titel

Computer Architecture and High Performance Computing (SBAC-PAD), 2012 IEEE 24th International Symposium on

Conference_Location

New York, NY

ISSN

1550-6533

Print_ISBN

978-1-4673-4790-7

Type

conf

DOI

10.1109/SBAC-PAD.2012.29

Filename

6374778