Title :
Performance Evaluation of Symbol Recognition and Spotting Systems: An Overview
Author :
Delalandre, Mathieu ; Valveny, Ernest ; Llados, Josep
Author_Institution :
CVC, Barcelona
Abstract :
This paper deals with the topic of performance evaluation of the symbol recognition & spotting systems. It presents an overview as a result of the work and the discussions undertaken by a working group on this subject. The paper starts by giving a general view of symbol recognition & spotting and performance evaluation. Next, the two main issues of performance evaluation are discussed: groundtruthing and performance characterization. Different problems related to both issues are addressed: groundtruthing of real documents, generation of synthetic documents, degradation models, the use of a priori knowledge, mapping of the groundtruth with the system results, and so on. Open problems arising from this overview are also discussed at the end of the paper.
Keywords :
document image processing; image recognition; spotting systems; symbol recognition; synthetic documents generation; Character recognition; Degradation; Graphics; Image recognition; Information retrieval; Pattern recognition; Performance analysis; System performance; System testing; Text analysis;
Conference_Titel :
Document Analysis Systems, 2008. DAS '08. The Eighth IAPR International Workshop on
Conference_Location :
Nara
Print_ISBN :
978-0-7695-3337-7
DOI :
10.1109/DAS.2008.63