Title :
Meeting predictable buffer limits in the parallel execution of event processing operators
Author :
Mayer, Ruben ; Koldehofe, Boris ; Rothermel, Kurt
Author_Institution :
Inst. for Parallel & Distrib. Syst., Univ. of Stuttgart, Stuttgart, Germany
Abstract :
Complex Event Processing (CEP) systems enable applications to react to live-situations by detecting event patterns (complex events) in data streams. With the increasing number of data sources and the increasing volume at which data is produced, parallelization of event detection is becoming of tremendous importance to limit the time events need to be buffered before they actually can be processed by an event detector - named event processing operator. In this paper, we propose a pattern-sensitive partitioning model for data streams that is capable of achieving a high degree of parallelism for event patterns which formerly could only be consistently detected in a sequential manner or at a low parallelization degree. Moreover, we propose methods to dynamically adapt the parallelization degree to limit the buffering imposed on event detection in the presence of dynamic changes to the workload. Extensive evaluations of the system behavior show that the proposed partitioning model allows for a high degree of parallelism and that the proposed adaptation methods are able to meet the buffering level for event detection under high and dynamic workloads.
Keywords :
buffer storage; data handling; parallel processing; CEP systems; buffering; complex event processing systems; data sources; data streams; data volume; dynamic workloads; event detection parallelization; event patterns detection; event processing operators; parallel execution; parallelization degree; pattern-sensitive partitioning model; predictable buffer limits; system behavior; time events; Adaptation models; Corporate acquisitions; Correlation; Delays; Event detection; Middleware; Monitoring; Complex Event Processing; Data Parallelization; Quality of Service; Self-Adaptation; Stream Processing;
Conference_Titel :
Big Data (Big Data), 2014 IEEE International Conference on
Conference_Location :
Washington, DC
DOI :
10.1109/BigData.2014.7004257