Title :
In-pipeline parallel execution using pass block buffer in column-stores
Author :
Ding Xiangwu ; Zhang Guanghui ; Tian Bo
Author_Institution :
Sch. of Comput. Sci. & Technol., Donghua Univ., Shanghai, China
Abstract :
Chip multiprocessor(CMP) becomes rapidly the leading role of the processor market due to its low-power dissipation, low cost and some other advantages. It provides hardware support for multithreading. Column-stores have significant advantages in OLAP. In column-stores, utilizing fully multi-core resources can greatly improve performance of query processing. To this end, this paper establishes passing block buffer to make main thread and worker threads read and write different passing blocks respectively, then parent node and child node of the physical execution tree execute in parallel. We use the classic producer-consumer pattern to solve the problem of synchronization between these threads. In the column-store system DWMS developed by our laboratory, experimental results on benchmark data set SSB show the effectiveness of this design, it can improve 50% execution performance for some typical complex queries.
Keywords :
data mining; low-power electronics; microprocessor chips; multi-threading; multiprocessing systems; pipeline processing; query processing; synchronisation; OLAP; chip multiprocessor; classic producer-consumer pattern; column-store system DWMS; column-stores; in-pipeline parallel execution; low-power dissipation; multicore resources; multithreading; pass block buffer; passing block buffer; physical execution tree; query processing; synchronization; Amplitude modulation; Buffer storage; Computers; Hardware; Instruction sets; Parallel processing; Query processing; Column-store; Multicore; Multithreading; Parallel Processing; Passing block Buffer;
Conference_Titel :
Mechatronic Sciences, Electric Engineering and Computer (MEC), Proceedings 2013 International Conference on
Conference_Location :
Shengyang
Print_ISBN :
978-1-4799-2564-3
DOI :
10.1109/MEC.2013.6885380