DocumentCode :
3007260
Title :
Automatic Calibration Using Receiver Operating Characteristics Curves
Author :
Kolan, Prakash ; Vaithilingam, Ram ; Dantu, Ram
Author_Institution :
Dept. of Comput. Sci., Univ. of North Texas, Denton, TX, USA
fYear :
2007
fDate :
7-12 Jan. 2007
Firstpage :
1
Lastpage :
8
Abstract :
Application-level filters, such as e-mail and VoIP spam filters, that analyze dynamic behavior changes are replacing static signature-recognition filters. These application-level filters learn behavior and use that knowledge to filter unwanted requests. Because behavior of a service request´s participating entities changes rapidly, filters must adapt quickly by using end user´s preferences about receiving that service request message. Many adaptive filters learn from the participating entities´ behavior; however, none configure themselves automatically to an end user´s changing tolerance levels. Also, filter administrators cannot manually change the threshold for each service request in real time. Traditional adaptive filters fail when administrators must optimize multiple filter thresholds manually and often. Thus, to improve a filter´s learning, we must automate its threshold-update process. We propose an automatic threshold-calibration mechanism using Receiver Operating Characteristics (ROC) curves that updates the threshold based on an end user´s feedback. To demonstrate the mechanism´s real-time applicability, we integrated it in a Voice over IP (VoIP) spam filter that analyzes incoming Spam over IP Telephony (SPIT) calls. Using this mechanism, we observed good improvement in the VoIP spam filter´s accuracy. Further, computing and updating the optimum threshold in realtime does not impede the filter´s temporal performance because we update thresholds after each call´s completion. Because we reach an optimum threshold for any initial setting, this mechanism works efficiently when we cannot predict end-user behavior. Furthermore, automatic calibration proves efficient when using multiple threshold values.
Keywords :
Internet telephony; adaptive filters; calibration; information filtering; information filters; learning (artificial intelligence); sensitivity analysis; adaptive filters; application-level filter learning; automatic threshold-calibration mechanism; end user feedback; receiver operating characteristics curves; service request message; Adaptive filters; Calibration; Computer science; Computer worms; Electronic mail; Filtering; Internet telephony; Protocols; Telecommunication traffic; Viruses (medical); Receiver Operating Characteristics curves; Threshold; Tolerance; behavior;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Communication Systems Software and Middleware, 2007. COMSWARE 2007. 2nd International Conference on
Conference_Location :
Bangalore
Print_ISBN :
1-4244-0613-7
Type :
conf
DOI :
10.1109/COMSWA.2007.382484
Filename :
4268127
Link To Document :
بازگشت