Mention-anomaly-based Event Detection and tracking in Twitter

The ever-growing number of people using Twitter makes it a valuable source of timely information. However, detecting events in Twitter is a difficult task, because tweets that report interesting events are overwhelmed by a large volume of tweets on unrelated topics. Existing methods focus on the textual content of tweets and ignore the social aspect of Twitter. In this paper we propose MABED (Mention-Anomaly-Based Event Detection), a novel method that leverages the creation frequency of dynamic links (i.e. mentions) that users insert in tweets to detect important events and estimate the magnitude of their impact over the crowd. The main advantages of MABED over prior works are that (i) it relies solely on tweets, meaning no external knowledge is required, and that (ii) it dynamically estimates the period of time during which each event is discussed rather than assuming a predefined fixed duration. The experiments we conducted on both English and French Twitter data show that the mention-anomaly-based approach leads to more accurate event detection and improved robustness in presence of noisy Twitter content. Last, we show that MABED helps with the interpretation of detected events by providing clear and precise descriptions.