Title :
Database compression techniques for performance optimization
Author_Institution :
Coll. of Eng., Fac. Comput., MIT, Pune, India
Abstract :
Data stored in databases keep growing as a result of businesses requirements for more information. A big portion of the cost of keeping large amounts of data is in the cost of disk systems, and the resources utilized in managing that data. This paper introduces various compression techniques for data stored in row oriented as well as column-oriented databases. Keeping data in this compressed format as it is operated upon has been shown to improve query performance by up to an order of magnitude. Intuitively, data stored in columns is more Compressible than data stored in rows. Compression algorithms perform better on data with low information entropy (high data value locality) i.e are used for optimization purpose.
Keywords :
data compression; database management systems; entropy; optimisation; businesses requirement; column-oriented databases; data storage; database compression techniques; disk system; information entropy; performance optimization; resource utilization; Costs; Data compression; Data engineering; Decoding; Dictionaries; Encoding; Engines; Hardware; Optimization; Relational databases; Cache-Conscious Optimisation; Column Stores; compression; decompression; row-stores;
Conference_Titel :
Computer Engineering and Technology (ICCET), 2010 2nd International Conference on
Conference_Location :
Chengdu
Print_ISBN :
978-1-4244-6347-3
DOI :
10.1109/ICCET.2010.5485951