DocumentCode
692958
Title
In-pipeline parallel execution using pass block buffer in column-stores
Author
Ding Xiangwu ; Zhang Guanghui ; Tian Bo
Author_Institution
Sch. of Comput. Sci. & Technol., Donghua Univ., Shanghai, China
fYear
2013
fDate
20-22 Dec. 2013
Firstpage
2007
Lastpage
2012
Abstract
Chip multiprocessor(CMP) becomes rapidly the leading role of the processor market due to its low-power dissipation, low cost and some other advantages. It provides hardware support for multithreading. Column-stores have significant advantages in OLAP. In column-stores, utilizing fully multi-core resources can greatly improve performance of query processing. To this end, this paper establishes passing block buffer to make main thread and worker threads read and write different passing blocks respectively, then parent node and child node of the physical execution tree execute in parallel. We use the classic producer-consumer pattern to solve the problem of synchronization between these threads. In the column-store system DWMS developed by our laboratory, experimental results on benchmark data set SSB show the effectiveness of this design, it can improve 50% execution performance for some typical complex queries.
Keywords
data mining; low-power electronics; microprocessor chips; multi-threading; multiprocessing systems; pipeline processing; query processing; synchronisation; OLAP; chip multiprocessor; classic producer-consumer pattern; column-store system DWMS; column-stores; in-pipeline parallel execution; low-power dissipation; multicore resources; multithreading; pass block buffer; passing block buffer; physical execution tree; query processing; synchronization; Amplitude modulation; Buffer storage; Computers; Hardware; Instruction sets; Parallel processing; Query processing; Column-store; Multicore; Multithreading; Parallel Processing; Passing block Buffer;
fLanguage
English
Publisher
ieee
Conference_Titel
Mechatronic Sciences, Electric Engineering and Computer (MEC), Proceedings 2013 International Conference on
Conference_Location
Shengyang
Print_ISBN
978-1-4799-2564-3
Type
conf
DOI
10.1109/MEC.2013.6885380
Filename
6885380
Link To Document