Title :
Load shedding for aggregation queries over data streams
Author :
Babcock, Brian ; Datar, Mayur ; Motwani, Rajeev
Author_Institution :
Dept. of Comput. Sci., Stanford Univ., CA, USA
fDate :
30 March-2 April 2004
Abstract :
Systems for processing continuous monitoring queries over data streams must be adaptive because data streams are often bursty and data characteristics may vary over time. We focus on one particular type of adaptivity: the ability to gracefully degrade performance via "load shedding" (dropping unprocessed tuples to reduce system load) when the demands placed on the system cannot be met in full given available resources. Focusing on aggregation queries, we present algorithms that determine at what points in a query plan should load shedding be performed and what amount of load should be shed at each point in order to minimize the degree of inaccuracy introduced into query answers. We report the results of experiments that validate our analytical conclusions.
Keywords :
load shedding; query processing; resource allocation; sampling methods; aggregation queries; continuous monitoring queries; data stream; load shedding; Adaptive systems; Computer science; Computerized monitoring; Control systems; Data engineering; Degradation; Information analysis; Information processing; Relational databases; Telecommunication traffic;
Conference_Titel :
Data Engineering, 2004. Proceedings. 20th International Conference on
Print_ISBN :
0-7695-2065-0
DOI :
10.1109/ICDE.2004.1320010