Title :
A Self-Scalable and Auto-Regulated Request Injection Benchmarking Tool for Automatic Saturation Detection
Author :
Tchana, Alain ; Dillenseger, Bruno ; De Palma, Noel ; Etchevers, Xavier ; Vincent, Jean-Marc ; Salmi, Nabila ; Harbaoui, Ahmed
Author_Institution :
LIG Lab., Univ. Joseph Fourier, Grenoble, France
fDate :
July-Sept. 1 2014
Abstract :
Software applications providers have always been required to perform load testing prior to launching new applications. This crucial test phase is expensive in human and hardware terms, and the solutions generally used would benefit from further development. In particular, designing an appropriate load profile to stress an application is difficult and must be done carefully to avoid skewed testing. In addition, static testing platforms are exceedingly complex to set up. New opportunities to ease load testing solutions are becoming available thanks to cloud computing. This paper describes a Benchmark-as-a-Service platform based on: (i) intelligent generation of traffic to the benched application without inducing thrashing (avoiding predefined load profiles), (ii) a virtualized and self-scalable load injection system. The platform developed was experimented using two use cases based on the reference JEE benchmark RUBiS. This involved detecting bottleneck tiers, and tuning servers to improve performance. This platform was found to reduce the cost of testing by 50 percent compared to more commonly used solutions.
Keywords :
benchmark testing; cloud computing; program testing; software performance evaluation; virtualisation; RUBiS JEE benchmark; auto-regulated request injection benchmarking tool; automatic saturation detection; benchmark-as-a-service platform; bottleneck tier detection; cloud computing; intelligent traffic generation; load profile; load testing; self-scalable load injection system; self-scalable request injection benchmarking tool; software applications; static testing platforms; testing cost reduction; virtualized load injection system; Benchmark testing; Cloud computing; Computer architecture; Monitoring; Probes; Time factors; Benchmarking as a service; cloud;
Journal_Title :
Cloud Computing, IEEE Transactions on
DOI :
10.1109/TCC.2014.2321169