DocumentCode :
1071461
Title :
Hierarchical Bayesian Modeling of Topics in Time-Stamped Documents
Author :
Pruteanu-Malinici, Iulian ; Ren, Lu ; Paisley, John ; Wang, Eric ; Carin, Lawrence
Author_Institution :
Dept. of Electr. & Comput. Eng., Duke Univ., Durham, NC, USA
Volume :
32
Issue :
6
fYear :
2010
fDate :
6/1/2010 12:00:00 AM
Firstpage :
996
Lastpage :
1011
Abstract :
We consider the problem of inferring and modeling topics in a sequence of documents with known publication dates. The documents at a given time are each characterized by a topic and the topics are drawn from a mixture model. The proposed model infers the change in the topic mixture weights as a function of time. The details of this general framework may take different forms, depending on the specifics of the model. For the examples considered here, we examine base measures based on independent multinomial-Dirichlet measures for representation of topic-dependent word counts. The form of the hierarchical model allows efficient variational Bayesian inference, of interest for large-scale problems. We demonstrate results and make comparisons to the model when the dynamic character is removed, and also compare to latent Dirichlet allocation (LDA) and Topics over Time (TOT). We consider a database of Neural Information Processing Systems papers as well as the US Presidential State of the Union addresses from 1790 to 2008.
Keywords :
belief networks; document handling; inference mechanisms; statistical distributions; documents sequence; hierarchical Bayesian modeling; independent multinomial-Dirichlet measurement; mixture model; time-stamped documents; topic modeling; topic-dependent word counts; variational Bayesian inference; Bayesian methods; Databases; Dictionaries; Hidden Markov models; Indexing; Information processing; Large-scale systems; Linear discriminant analysis; Sorting; Sparse matrices; Dirichlet process; Hierarchical models; text modeling.; variational Bayes;
fLanguage :
English
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
Publisher :
ieee
ISSN :
0162-8828
Type :
jour
DOI :
10.1109/TPAMI.2009.125
Filename :
5072227
Link To Document :
بازگشت