Title :
Work in Progress: Building a Distributed Generic Stress Tool for Server Performance and Behavior Analysis
Author :
Casanovas, Ada ; Alonso, Javier ; Torres, Jordi ; Andrzejak, Artur
Author_Institution :
Comput. Archit. Dept., Tech. Univ. of Catalonia, Barcelona
Abstract :
One of the primary tools for performance analysis of multi-tier systems are standardized benchmarks. They are used to evaluate system behavior under different circumstances to assess whether a system can handle real workloads in a production environment. Such benchmarks are also helpful to resolve situations when a system has an unacceptable performance or even crashes. System administrators and developers use these tools for reproducing and analyzing circumstances which provoke the errors or performance degradation. However, standardized benchmarks are usually constrained to simulating a set of pre-fixed workload distributions. We present a benchmarking framework which overcomes this limitation by generating real workloads from pre-recorded system traces. This distributed tool allows more realistic testing scenarios, and thus exposes the behavior and limits of a tested system with more details. Further advantage of our framework is its flexibility. For example, it can be used to extend standardized benchmarks like TPC-W thus allowing them to incorporate workload distributions derived from real workloads.
Keywords :
Web services; benchmark testing; program testing; resource allocation; software performance evaluation; system monitoring; system recovery; TPC-W; Web service quality; benchmarking framework; distributed generic stress tool; multitier system; server behavior analysis; server performance analysis; system crash; system trace; testing scenario; workload distribution simulation; Benchmark testing; Computer architecture; Computer crashes; Internet; Job shop scheduling; Performance analysis; Quality of service; Stress; System testing; Vehicle crash testing; Benchmarking; Dependability; Performance Analysis;
Conference_Titel :
Autonomic and Autonomous Systems, 2009. ICAS '09. Fifth International Conference on
Conference_Location :
Valencia
Print_ISBN :
978-1-4244-3684-2
Electronic_ISBN :
978-0-7695-3584-5
DOI :
10.1109/ICAS.2009.53