Title :
Toward an empirical approach to evaluating the knowledge base of an expert system
Author_Institution :
Dept. of Inf. Syst. & Syst. Eng., George Mason Univ., Fairfax, VA, USA
Abstract :
A general approach is described to the test and evaluation of an expert system knowledge base that involves the use of a representative set of randomly selected test problems and the application of well-defined statistical measures of accuracy and bias for each node in an inference network. Using the analogy that each node can be treated as a signal detector, some elements of a mathematics consistent with the approach are developed
Keywords :
expert systems; accuracy; bias; expert system; inference network; knowledge base; signal detector; statistical measures; test problems; Artificial intelligence; Detectors; Expert systems; Humans; Knowledge engineering; Mathematics; Sensor fusion; Sensor systems; Signal detection; System testing;
Journal_Title :
Systems, Man and Cybernetics, IEEE Transactions on