Title :
Parallel Distributed Processing of Constrained Skyline Queries by Filtering
Author :
Cui, Bin ; Lu, Hua ; Xu, Quanqing ; Chen, Lijiang ; Dai, Yafei ; Zhou, Yongluan
Author_Institution :
Dept. of Comput. Sci., Peking Univ., Beijing
Abstract :
Skyline queries are capable of retrieving interesting points from a large data set according to multiple criteria. Most work on skyline queries so far has assumed a centralized storage, whereas in practice relevant data are often distributed among geographically scattered sites. In this work, we tackle constrained skyline queries in large-scale distributed environments without the assumption of any overlay structures, and propose a novel algorithm named PaDSkyline (Parallel distributed Skyline query processing). PaDSkyline significantly shortens the response time by performing parallel processing over site groups produced by a partition algorithm. Within each group, it locally optimizes the query processing over distributed sites. It also drastically enhances the network transmission efficiency by performing early reduction of skyline candidates with deliberately selected multiple filtering points. Results of extensive experiments demonstrate the efficiency and robustness of our proposals.
Keywords :
information filtering; parallel processing; query processing; PaDSkyline; centralized storage; constrained skyline queries; filtering; large data set; large-scale distributed environment; multiple criteria; overlay structures; parallel distributed processing; parallel distributed skyline query processing; Delay; Distributed processing; Filtering; Information retrieval; Large-scale systems; Parallel processing; Partitioning algorithms; Query processing; Robustness; Scattering;
Conference_Titel :
Data Engineering, 2008. ICDE 2008. IEEE 24th International Conference on
Conference_Location :
Cancun
Print_ISBN :
978-1-4244-1836-7
Electronic_ISBN :
978-1-4244-1837-4
DOI :
10.1109/ICDE.2008.4497463