DocumentCode :
2721726
Title :
Fulfilling end-to-end latency constraints in large-scale streaming environments
Author :
Rizou, Stamatia ; Durr, F. ; Rothermel, Kurt
Author_Institution :
Inst. of Parallel & Distrib. Syst., Univ. Stuttgart, Stuttgart, Germany
fYear :
2011
fDate :
17-19 Nov. 2011
Firstpage :
1
Lastpage :
8
Abstract :
The on-line processing of high volume data streams is a prerequisite for many modern applications relying on real-time data such as global sensor networks or multimedia streaming. In order to achieve efficient data processing and scalability w.r.t. the number of distributed data sources and applications, in-network processing of data streams in an overlay network of data processing operators has been proposed. For such stream processing overlay networks, the placement of operators onto physical hosts plays an important role for the resulting quality of service - in particular, the end-to-end latency - and network load. To this end, we present an enhanced placement algorithm that minimizes the network load put onto the system by a stream processing task under user-defined delay constraints in this paper. Our algorithm finds first the optimal solution in terms of network load and then degrades this solution to find a constrained optimum. In order to reduce the overhead of the placement algorithm, we included mechanisms to reduce the search space in terms of hosts that are considered during operator placement. Our evaluations show that this approach leads to an operator placement of high quality solution while inducing communication overhead proportional only to a small percentage of the total hosts.
Keywords :
media streaming; communication overhead; data processing operators; end-to-end latency constraints; global sensor networks; high volume data streams; large-scale streaming environment; multimedia streaming; network load; online processing; operator placement; placement algorithm; quality of service; scalability; search space; stream processing overlay networks; stream processing task; user-defined delay constraints; Delay; Distributed databases; Load management; Optimization; Propagation delay; Quality of service;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Performance Computing and Communications Conference (IPCCC), 2011 IEEE 30th International
Conference_Location :
Orlando, FL
ISSN :
1097-2641
Print_ISBN :
978-1-4673-0010-0
Type :
conf
DOI :
10.1109/PCCC.2011.6108086
Filename :
6108086
Link To Document :
بازگشت