A framework for simulation validation coverage

Although verification and validation have been studied for modeling and simulation for many decades, we do not yet have a quantitative measure of the level of validation performed on a simulation model. Validation is especially important as it determines whether or not the results from the simulation model can be trusted and used to make statements about the studied system. We propose a validation coverage metric to quantify the validation performed on a simulation model based on the possible validation that could be performed on it. This metric takes into account the aspects of the simulation model that should be validated. To show how such a metric could be utilized, we propose a version of the metric specific to agent-based models, and analyze three example models. We find that the coverage metric can be used to quantify validation on a variety of simulation models.