DocumentCode :
3103777
Title :
Stream Monitoring in Large-Scale Distributed Concealed Environments
Author :
Lassnig, Mario ; Fahringer, Thomas ; Garonne, Vincent ; Molfetas, Angelos ; Branco, Miguel
Author_Institution :
Distrib. & Parallel Syst., Univ. of Innsbruck, Innsbruck, Austria
fYear :
2009
fDate :
9-11 Dec. 2009
Firstpage :
156
Lastpage :
163
Abstract :
We present a probabilistic tracing method that captures both user and system behaviour for large-scale distributed applications. Our method extends the notion of data stream monitoring to work within what we define as concealed environments. We detail the conceptual design and implementation of our method. Additionally, we evaluate the scalability of the tracing method in a real petabyte-scale distributed data management system. Finally, we demonstrate the usefulness of the collected trace data in three scenarios. First, we use collected trace data to examine the arrival of user events and find self-similar processes. Second, we examine the behaviour and performance of mass storage systems in a grid under concurrent requests. Third, we develop a model for prediction of user event arrivals based on historical data. Our results suggest that a probabilistic tracing method is scalable, straightforward to integrate with existing applications, and provides useful insight into the behaviour of very large-scale applications.
Keywords :
concurrency control; data analysis; distributed databases; grid computing; probability; storage management; collected trace data; concurrent requests; data stream monitoring; large-scale distributed applications; large-scale distributed concealed environments; mass storage systems; probabilistic tracing method; real petabyte-scale distributed data management system; system behaviour; Application software; Cloud computing; Computerized monitoring; Conference management; Environmental management; Grid computing; Large-scale systems; Nuclear electronics; Predictive models; Resource management; analysis; data management; distributed systems; grid computing; monitoring;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
e-Science, 2009. e-Science '09. Fifth IEEE International Conference on
Conference_Location :
Oxford
Print_ISBN :
978-0-7695-3877-8
Type :
conf
DOI :
10.1109/e-Science.2009.30
Filename :
5380871
Link To Document :
بازگشت