Title :
The AETG system: an approach to testing based on combinatorial design
Author :
Cohen, David M. ; Dalal, Siddhartha R. ; Fredman, Michael L. ; Patton, Gardner C.
Author_Institution :
IDA Center for Comput. Sci., Bowie, MD, USA
fDate :
7/1/1997 12:00:00 AM
Abstract :
This paper describes a new approach to testing that uses combinatorial designs to generate tests that cover the pairwise, triple, or n-way combinations of a system´s test parameters. These are the parameters that determine the system´s test scenarios. Examples are system configuration parameters, user inputs and other external events. We implemented this new method in the AETG system. The AETG system uses new combinatorial algorithms to generate test sets that cover all valid n-way parameter combinations. The size of an AETG test set grows logarithmically in the number of test parameters. This allows testers to define test models with dozens of parameters. The AETG system is used in a variety of applications for unit, system, and interoperability testing. It has generated both high-level test plans and detailed test cases. In several applications, it greatly reduced the cost of test plan development
Keywords :
open systems; program testing; software cost estimation; software tools; AETG system; combinatorial design; high-level test plans; interoperability testing; n-way parameter combination; pairwise parameter combination; software testing; system configuration parameters; system test parameters; system testing; test scenarios; test set generation; triple parameter combination; unit testing; user inputs; Application software; Asynchronous transfer mode; Computer Society; Costs; Design for experiments; Monitoring; Programming; Software testing; System testing; Telephony;
Journal_Title :
Software Engineering, IEEE Transactions on