Title :
Heuristic metrics for AI problem domains such as natural language processing
Author_Institution :
Dept. of Comput. Sci., Alabama A&M Univ., Normal, AL, USA
Abstract :
It is proposed that a series of numeric metrics be established for the evaluation of problem domains such as natural-language processing. These metrics should be weighted averages of multiple independent factors and should be constructed so that typical human-level performance is taken to be unity. The usage of such metrics is discussed, and the example of natural language processing is detailed with a suggested metric delineated
Keywords :
artificial intelligence; heuristic programming; natural languages; performance evaluation; AI problem domains; natural language processing; numeric metrics; Artificial intelligence; Computer science; Face; Humans; Measurement standards; Natural language processing; Pattern recognition; Project management; Software packages; Standards development;
Conference_Titel :
System Theory, 1989. Proceedings., Twenty-First Southeastern Symposium on
Conference_Location :
Tallahassee, FL
Print_ISBN :
0-8186-1933-3
DOI :
10.1109/SSST.1989.72549