Title :
Statistical inference on recall, precision and average precision under random selection
Author :
Zhang, Peng ; Su, Wanhua
Author_Institution :
Dept. of Math., Zhejiang Univ., Hangzhou, China
Abstract :
The objective of a rare target detection problem is to identify the rare targets as early as possible. Recall, precision and average precision are three popular performance measures for evaluating different detection methods. However, there is little literature on the statistical properties of these three measures. We develop a framework for conducting statistical inference on recall, precision and average precision through establishing their asymptotic properties. Simulations are used to illustrate the idea. The proposed methods can also be applied in other areas where ranking systems need to be evaluated, such as information retrieval.
Keywords :
inference mechanisms; information retrieval; object detection; random processes; statistical analysis; asymptotic properties; average precision; detection methods; information retrieval; performance measures; random selection; ranking systems; rare target detection problem; rare target identification; recall; statistical inference; Educational institutions; Equations; Information retrieval; Joints; Mathematical model; Object detection; Vectors;
Conference_Titel :
Fuzzy Systems and Knowledge Discovery (FSKD), 2012 9th International Conference on
Conference_Location :
Sichuan
Print_ISBN :
978-1-4673-0025-4
DOI :
10.1109/FSKD.2012.6234049