DocumentCode
1791580
Title
Meeting predictable buffer limits in the parallel execution of event processing operators
Author
Mayer, Ruben ; Koldehofe, Boris ; Rothermel, Kurt
Author_Institution
Inst. for Parallel & Distrib. Syst., Univ. of Stuttgart, Stuttgart, Germany
fYear
2014
fDate
27-30 Oct. 2014
Firstpage
402
Lastpage
411
Abstract
Complex Event Processing (CEP) systems enable applications to react to live-situations by detecting event patterns (complex events) in data streams. With the increasing number of data sources and the increasing volume at which data is produced, parallelization of event detection is becoming of tremendous importance to limit the time events need to be buffered before they actually can be processed by an event detector - named event processing operator. In this paper, we propose a pattern-sensitive partitioning model for data streams that is capable of achieving a high degree of parallelism for event patterns which formerly could only be consistently detected in a sequential manner or at a low parallelization degree. Moreover, we propose methods to dynamically adapt the parallelization degree to limit the buffering imposed on event detection in the presence of dynamic changes to the workload. Extensive evaluations of the system behavior show that the proposed partitioning model allows for a high degree of parallelism and that the proposed adaptation methods are able to meet the buffering level for event detection under high and dynamic workloads.
Keywords
buffer storage; data handling; parallel processing; CEP systems; buffering; complex event processing systems; data sources; data streams; data volume; dynamic workloads; event detection parallelization; event patterns detection; event processing operators; parallel execution; parallelization degree; pattern-sensitive partitioning model; predictable buffer limits; system behavior; time events; Adaptation models; Corporate acquisitions; Correlation; Delays; Event detection; Middleware; Monitoring; Complex Event Processing; Data Parallelization; Quality of Service; Self-Adaptation; Stream Processing;
fLanguage
English
Publisher
ieee
Conference_Titel
Big Data (Big Data), 2014 IEEE International Conference on
Conference_Location
Washington, DC
Type
conf
DOI
10.1109/BigData.2014.7004257
Filename
7004257
Link To Document