Text Classification Based on a Novel Bayesian Hierarchical Model

In the text literature, many Bayesian generative models were proposed to represent documents and words in order to process text effectively and accurately. As the most popular one of these models, Latent Dirichlet Allocation Model(LDA) did great job in dimensionality reduction for document classification. In this paper, inspiring by latent Dirichlet allocation model, we propose LDCM or latent Dirichlet category model for text classification rather than dimensionality reduction. LDCM estimate parameters of models by variational inference and use variational parameters to estimate maximum a posteriori of terms. As demonstrated by our experimental results, we report satisfactory categorization performances about our method on various real-world text documents.