• DocumentCode
    692958
  • Title

    In-pipeline parallel execution using pass block buffer in column-stores

  • Author

    Ding Xiangwu ; Zhang Guanghui ; Tian Bo

  • Author_Institution
    Sch. of Comput. Sci. & Technol., Donghua Univ., Shanghai, China
  • fYear
    2013
  • fDate
    20-22 Dec. 2013
  • Firstpage
    2007
  • Lastpage
    2012
  • Abstract
    Chip multiprocessor(CMP) becomes rapidly the leading role of the processor market due to its low-power dissipation, low cost and some other advantages. It provides hardware support for multithreading. Column-stores have significant advantages in OLAP. In column-stores, utilizing fully multi-core resources can greatly improve performance of query processing. To this end, this paper establishes passing block buffer to make main thread and worker threads read and write different passing blocks respectively, then parent node and child node of the physical execution tree execute in parallel. We use the classic producer-consumer pattern to solve the problem of synchronization between these threads. In the column-store system DWMS developed by our laboratory, experimental results on benchmark data set SSB show the effectiveness of this design, it can improve 50% execution performance for some typical complex queries.
  • Keywords
    data mining; low-power electronics; microprocessor chips; multi-threading; multiprocessing systems; pipeline processing; query processing; synchronisation; OLAP; chip multiprocessor; classic producer-consumer pattern; column-store system DWMS; column-stores; in-pipeline parallel execution; low-power dissipation; multicore resources; multithreading; pass block buffer; passing block buffer; physical execution tree; query processing; synchronization; Amplitude modulation; Buffer storage; Computers; Hardware; Instruction sets; Parallel processing; Query processing; Column-store; Multicore; Multithreading; Parallel Processing; Passing block Buffer;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Mechatronic Sciences, Electric Engineering and Computer (MEC), Proceedings 2013 International Conference on
  • Conference_Location
    Shengyang
  • Print_ISBN
    978-1-4799-2564-3
  • Type

    conf

  • DOI
    10.1109/MEC.2013.6885380
  • Filename
    6885380