An automated performance evaluation system for speech recognizers used in the telephone network

An automated evaluation system for measuring the performance of speech recognition devices is described. The use of an automated and reconfigurable test facility allows for the expedient evaluation of speech recognition systems used in specific applications of interest. It also allows the recognizers to be tested against speech data that reflects a number of operating environments. A host computer that runs a real-time UNIX environment for recognition system control and database management is used. By eliminating the need for continuous human intervention in the test and evaluation processes, performance measurement is greatly facilitated. Results from the testing of several off-the-shelf speech recognition devices on a specific application task are discussed