DocumentCode
2319525
Title
F-score-like measure: A new measure for spam filtering
Author
Han, Yong ; Qi, Hao-liang ; Yang, Mu-yun
Author_Institution
Sch. of Comput. Sci. & Technol., Heilongjiang Inst. of Technol., Harbin, China
Volume
5
fYear
2012
fDate
15-17 July 2012
Firstpage
2047
Lastpage
2051
Abstract
Logistic average misclassification percentage (lam%) and I-AVC(area under the ROC curve) are two important and wildly adopted measures. This paper demonstrates that a spam filter can achieve a perfect 0.00% in lam%, the minimal value in theory, by simply setting a biased threshold during the classifier modeling. At the same time, I-AVC is left untouched; and the overall classification performance reaches only a low accuracy. This means that lam% and I-AVC as main measures for spam filtering are not suitable. To solve the problem of measuring spam filtering, F-score-like measure based on ham and spam misclassification is proposed to be a single measure for spam filtering evaluation.
Keywords
classification; information filtering; sensitivity analysis; unsolicited e-mail; F-score-like measure; I-AVC; area under the ROC curve; biased threshold; classifier modeling; ham misclassification; logistic average misclassification percentage; spam filtering; spam misclassification; Abstracts; Accuracy; Computational modeling; Filtering; Unsolicited electronic mail; Evaluation measure; F-score-like measure; I-AVC; Logistic average misclassification percentage; Spam filter;
fLanguage
English
Publisher
ieee
Conference_Titel
Machine Learning and Cybernetics (ICMLC), 2012 International Conference on
Conference_Location
Xian
ISSN
2160-133X
Print_ISBN
978-1-4673-1484-8
Type
conf
DOI
10.1109/ICMLC.2012.6359691
Filename
6359691
Link To Document