Title :
Efficient and accurate learning of Bayesian networks using chi-squared independence tests
Author :
Yi Tang ; Srihari, Sargur N.
Abstract :
Bayesian network structure learning is a well-known NP-complete problem, whose solution is of importance in machine learning. Two algorithms are proposed, both of which assess dependency between variables using the chi-squared test of independence between pairs of variables and the log-likelihood evaluation criterion for the network. The first determines the effect of adding a potential edge (in both directions) on the log-likelihood. The second uses K-L divergence to determine direction, and edges to be included are determined by thresholding normalized chi-squared statistics. Experiments on multinomial data show that the proposed algorithms are more efficient and accurate than an optimized branch and bound algorithm, and human experts.
Keywords :
belief networks; computational complexity; learning (artificial intelligence); statistical testing; Bayesian network structure learning; K-L divergence; NP-complete problem; branch and bound algorithm; chi-squared independence tests; log-likelihood evaluation criterion; machine learning; multinomial data; normalized chi-squared statistics thresholding; Algorithm design and analysis; Approximation algorithms; Bayesian methods; Humans; Joints; Machine learning; Sensitivity;
Conference_Titel :
Pattern Recognition (ICPR), 2012 21st International Conference on
Conference_Location :
Tsukuba
Print_ISBN :
978-1-4673-2216-4