Title :
Improving In-memory Column-Store Database Predicate Evaluation Performance on Multi-core Systems
Author :
Min, Hong ; Franke, Hubertus
Author_Institution :
IBM T. J. Watson Res. Center, Yorktown Heights, NY, USA
Abstract :
The ability to analyze a large volume of data for the purpose of business intelligence has led to various innovations in database technology. One example is the increased interest of using column-oriented data layout to address query performance in analytical and warehousing workloads. As system architectures move towards multi-core designs, it is important to address optimizing performance for these workloads on these platforms. In this paper we present SPHINX, an architecture that utilizes multi-core systems for search-based predicate evaluation operations in analytical query workloads against in-memory column store. We discuss the natural parallelism of predicate evaluations and various bottlenecks that impact search performance. We present several performance improvement techniques and apply a scan sharing technique based on cache reuse efficiency to further improve the performance. We demonstrate the performance benefits of our scan sharing scheduler over other scheduling approaches in a workload of mixed search queries.
Keywords :
database management systems; multiprocessing systems; parallel processing; query processing; storage management; SPHINX; analytical query workloads; business intelligence; cache reuse efficiency; column-oriented data layout; database technology; in-memory column store; in-memory column-store database predicate evaluation performance; multicore designs; multicore systems; natural parallelism; performance improvement; query performance; scan sharing; search performance; search-based predicate evaluation operations; system architectures; Bandwidth; Databases; Filtering; Layout; Prefetching; Throughput; column store; in-memory database; multi-core; scan sharing;
Conference_Titel :
Computer Architecture and High Performance Computing (SBAC-PAD), 2010 22nd International Symposium on
Conference_Location :
Petropolis
Print_ISBN :
978-1-4244-8287-0
Electronic_ISBN :
1550-6533
DOI :
10.1109/SBAC-PAD.2010.17