Title :
Hierarchical Bayesian Modeling of Topics in Time-Stamped Documents
Author :
Pruteanu-Malinici, Iulian ; Ren, Lu ; Paisley, John ; Wang, Eric ; Carin, Lawrence
Author_Institution :
Dept. of Electr. & Comput. Eng., Duke Univ., Durham, NC, USA
fDate :
6/1/2010 12:00:00 AM
Abstract :
We consider the problem of inferring and modeling topics in a sequence of documents with known publication dates. The documents at a given time are each characterized by a topic and the topics are drawn from a mixture model. The proposed model infers the change in the topic mixture weights as a function of time. The details of this general framework may take different forms, depending on the specifics of the model. For the examples considered here, we examine base measures based on independent multinomial-Dirichlet measures for representation of topic-dependent word counts. The form of the hierarchical model allows efficient variational Bayesian inference, of interest for large-scale problems. We demonstrate results and make comparisons to the model when the dynamic character is removed, and also compare to latent Dirichlet allocation (LDA) and Topics over Time (TOT). We consider a database of Neural Information Processing Systems papers as well as the US Presidential State of the Union addresses from 1790 to 2008.
Keywords :
belief networks; document handling; inference mechanisms; statistical distributions; documents sequence; hierarchical Bayesian modeling; independent multinomial-Dirichlet measurement; mixture model; time-stamped documents; topic modeling; topic-dependent word counts; variational Bayesian inference; Bayesian methods; Databases; Dictionaries; Hidden Markov models; Indexing; Information processing; Large-scale systems; Linear discriminant analysis; Sorting; Sparse matrices; Dirichlet process; Hierarchical models; text modeling.; variational Bayes;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
DOI :
10.1109/TPAMI.2009.125