Title :
Research on Cost-Efficient Processing of Continuous Extreme Queires
Author :
Kong, Xuehui ; Wang, Shuyang ; Yuehua Li ; Li, Yuehua
Author_Institution :
Coll. of Mech. & Electr. Eng., Northeast Forestry Univ., Harbin, China
Abstract :
We address the problem of cost-efficient processing of continuous extreme queries (MAX or MIN) over distributed sliding window streams, and propose several methods for communication reduction and resource sharing among queries. Firstly, we develop an effective pruning technique to minimize the number of elements to be kept. It can be shown that on average only O(logN) key points need to be stored for exact answer of extreme query, where N is the number of points contained in the sliding window. Then we consider the distributed environment, where remote nodes delay the data transmission as late as possible, and adopt the pruning strategy to filter local stream tuples, which is quite efficient in communication reduction. Analytical analysis and experimental evidences show the efficiency of proposed approach both on storage/communication reduction and efficiency improvement.
Keywords :
distributed processing; query processing; communication reduction; continuous extreme queries; cost-efficient processing; data transmission; distributed environment; distributed sliding window streams; pruning technique; resource sharing; storage reduction; Aggregates; Costs; Delay; Educational institutions; Forestry; Information technology; Monitoring; Real time systems; Resource management; Telecommunication traffic; communication reduction; continuous extreme value queries; data pruning; distributed data stream; resource sharing;
Conference_Titel :
Intelligent Information Technology Application, 2009. IITA 2009. Third International Symposium on
Conference_Location :
Nanchang
Print_ISBN :
978-0-7695-3859-4
DOI :
10.1109/IITA.2009.133