Title :
The Performance Cockpit Approach: A Framework For Systematic Performance Evaluations
Author :
Westermann, Dennis ; Happe, Jens ; Hauck, Michael ; Heupel, Christian
Author_Institution :
SAP Res., Karlsruhe, Germany
Abstract :
Evaluating the performance (timing behavior, throughput, and resource utilization) of a software system becomes more and more challenging as today´s enterprise applications are built on a large basis of existing software (e.g. middleware, legacy applications, and third party services). As the performance of a system is affected by multiple factors on each layer of the system, performance analysts require detailed knowledge about the system under test and have to deal with a huge number of tools for benchmarking, monitoring, and analyzing. In practice, performance analysts try to handle the complexity by focusing on certain aspects, tools, or technologies. However, these isolated solutions are inefficient due to the small reuse and knowledge sharing. The Performance Cockpit presented in this paper is a framework that encapsulates knowledge about performance engineering, the system under test, and analyses in a single application by providing a flexible, plug-in based architecture. We demonstrate the value of the framework by means of two different case studies.
Keywords :
software performance evaluation; performance cockpit approach; resource utilization; systematic performance evaluations; timing behavior; Adaptation model; Benchmark testing; Control systems; Measurement; Monitoring; Software systems; Unified modeling language; Framework; Performance Cockpit; Performance Evaluation; Statistical Inference;
Conference_Titel :
Software Engineering and Advanced Applications (SEAA), 2010 36th EUROMICRO Conference on
Conference_Location :
Lille
Print_ISBN :
978-1-4244-7901-6
DOI :
10.1109/SEAA.2010.24