Title :
PnP: parallel and external memory iceberg cube computation
Author :
Chen, Ying ; Dehne, Frank ; Eavis, Todd ; Rau-Chaplin, Andrew
Author_Institution :
Dalhousie Univ., Halifax, NS, Canada
Abstract :
We present "Pipe \´n Prune" (PnP), a new hybrid method for iceberg-cube query computation. The novelty of our method is that it achieves a tight integration of top-down piping for data aggregation with bottom-up a priori data pruning. A particular strength of PnP is that it is very efficient for all of the following scenarios: (1) Sequential iceberg-cube queries. (2) External memory iceberg-cube queries. (3) Parallel iceberg-cube queries on shared-nothing PC clusters with multiple disks.
Keywords :
data mining; data structures; data warehouses; query processing; Pipe n Prune hybrid method; bottom-up a priori data pruning; data aggregation; memory iceberg-cube query computation; top-down piping; Clustering algorithms; Concurrent computing; Data structures; Delay; Load management; Performance analysis; Processor scheduling; Scalability; Sorting; Switches;
Conference_Titel :
Data Engineering, 2005. ICDE 2005. Proceedings. 21st International Conference on
Print_ISBN :
0-7695-2285-8
DOI :
10.1109/ICDE.2005.107