Title :
Parallel optimization of large join queries with set operators and aggregates in a parallel environment supporting pipeline
Author :
Spiliopoulou, Myra ; Hatzopoulos, Michael ; Cotronis, Yannis
Author_Institution :
Humboldt-Univ., Berlin, Germany
fDate :
6/1/1996 12:00:00 AM
Abstract :
Proposes a parallel optimizer for queries containing a large number of joins, as well as set operators and aggregate functions. The platform for the execution is a shared-disk multiprocessor machine supporting bushy parallelism and pipeline processing. Our model partitions the query into almost independent subtrees that can be optimized simultaneously, and it applies an enhanced variation of the iterative improvement technique on those subtrees which contain a large number of joins; this technique is parallelized, too. In order to estimate the cost of the states constructed during the optimization of join subtrees, cost formulae are developed that estimate the cost of relational algebra operators when executed across coalescing pipes
Keywords :
magnetic disc storage; optimisation; parallel algorithms; pipeline processing; query processing; relational algebra; set theory; tree data structures; aggregate functions; almost independent subtrees; bushy parallelism; coalescing pipes; cost formulae; database querying; iterative improvement technique; join subtrees; large join queries; parallel query optimization; pipeline processing; query partitioning; relational algebra operators; set operators; shared-disk multiprocessor machine; simultaneous optimization; state cost estimation; Aggregates; Algebra; Computer Society; Cost function; Informatics; Parallel processing; Pipeline processing; Query processing; Relational databases; State estimation;
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on