Title :
FPGA implementation of GZIP compression and decompression for IDC services
Author :
Ouyang, Jian ; Luo, Hong ; Wang, Zilong ; Tian, Jiazi ; Liu, Chenghui ; Sheng, Kehua
Author_Institution :
Syst. Group, Baidu Inc., China
Abstract :
In the large scale data processing of Internet, data compression and decompression is a very important technology which can significantly improve the valid capacity of the disk and the valid bandwidth of IO, which can reduce the costs of IDC and accelerate application programs. This paper describes a low-cost FPGA hardware architecture of GZIP compression and decompression, which has been applied to IDC services successfully. Depending on different applications, the disk IO utilization has been improved by 300 to 500 percent, and the programs are accelerated by 30% to 200%, while 1 to 3 CPU-core resources could be released.
Keywords :
data compression; field programmable gate arrays; FPGA hardware architecture; GZIP compression; IDC service decompression; Internet; disk IO utilization; large scale data processing; Bandwidth; Computer architecture; Distributed databases; Field programmable gate arrays; Hardware; Random access memory; Software; FPGA; GZIP; IDC;
Conference_Titel :
Field-Programmable Technology (FPT), 2010 International Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4244-8980-0
DOI :
10.1109/FPT.2010.5681489