Title :
Evaluating a method to detect temporal trends of phrases in research documents
Author :
Abe, Hidenao ; Tsumoto, Shusaku
Author_Institution :
Sch. of Med., Shimane Univ., Japan
Abstract :
In text mining processes, the importance indices of the technical terms play a key role in finding valuable patterns from various documents. Further, methods for finding emergent terms have attracted considerable attention as an important issue called temporal text mining. However, many conventional methods are not robust against changes in technical terms. In order to detect remarkable temporal trends of technical terms in given textual datasets robustly, we propose a method based on temporal changes in several importance indices by assuming the importance indices of the terms to be a dataset. Empirical studies show that two representative importance indices are applied to the documents from two research areas. After detecting the temporal trends, we compared the emergent trend of the technical phrases to some emergent phrases given by a domain expert.
Keywords :
data mining; information retrieval; text analysis; temporal changes; temporal text mining; temporal trends; textual datasets; valuable patterns; Abstracts; Computational complexity; Data mining; Frequency; Hidden Markov models; Linear regression; Robustness; Sliding mode control; Statistics; Text mining; Jaccard Coefficient; Linear Regression; TF-IDF; Text Mining; Trend Detection;
Conference_Titel :
Cognitive Informatics, 2009. ICCI '09. 8th IEEE International Conference on
Conference_Location :
Kowloon, Hong Kong
Print_ISBN :
978-1-4244-4642-1
DOI :
10.1109/COGINF.2009.5250711