Strategies for evaluating indicators based on guidelines from the Environmental Protection Agency’s Office of Research and Development

The Environmental Protection Agency’s Office of Research and Development (ORD) has prepared technical guidelines to evaluate the suitability of ecological indicators for monitoring programs. The guidelines were adopted by ORD to provide a consistent framework for indicator review, comparison and selection, and to provide direction for research on indicator development. The guidelines were organized within four evaluation phases: (1) conceptual relevance; (2) feasibility of implementation; (3) response variability; (4) interpretation and utility. Three example indicators were analyzed to illustrate the use of the guidelines in an evaluation. The examples included a direct chemical measurement (dissolved oxygen concentration), an estuarine benthic community index, and a stream fish community index of biotic integrity. Comparison of the three examples revealed differences in approach, style and types of information used to address each guideline. The Evaluation Guidelines were intended to be flexible within a consistent framework and the various strategies used in the examples demonstrate that the process can be useful for a wide variety of indicators and program objectives.