DocumentCode :
468969
Title :
A hybrid generative-discriminative learning algorithm for Bayesian network structure
Author :
Jin, Xiao-Bo ; Hou, Xin-wen ; Liu, Cheng-Lin
Author_Institution :
Chinese Acad. of Sci., Beijing
Volume :
2
fYear :
2007
fDate :
2-4 Nov. 2007
Firstpage :
618
Lastpage :
623
Abstract :
The discriminative learning of Bayesian networks benefits the classification accuracy as compared to generative learning. Previous approaches mostly learn either the structure or the parameters in a discriminative manner based on the scoring+ search paradigm. Many works have focused on structure learning by optimizing a discriminative scoring function but the resulted structure is still generative in the sense that the class variable is not conditioned on attribute variables. On the other hand, searching Markov Blanket in a constrained space can generate a hybrid generative-discriminative structure. In this paper, we propose a new hybrid generative-discriminative (HGD) algorithm for learning Bayesian network structure. The algorithm searches the neighboring structures by optimizing a cross-validated classification rate (CR) criterion to give a really discriminative structure. We select the initial structure and design neighborhood operators appropriately such that the learning procedure is computationally feasible. Our empirical study on a large suite of bench-mark datasets shows that the proposed HGD+CR algorithm yields better classification results than BN classifiers with only discriminative scores.
Keywords :
Markov processes; belief networks; learning (artificial intelligence); pattern classification; Bayesian network; Markov Blanket; classification accuracy; classification rate; hybrid generative-discriminative learning algorithm; Bayesian methods; Chromium; Hybrid power systems; Maximum likelihood estimation; Niobium; Notice of Violation; Parameter estimation; Pattern analysis; Pattern recognition; Wavelet analysis; Bayesian Network; Classification; Discriminative Learning; Discriminative Structure; Generative Leaning; Generative Structure; Markov Blanket;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Wavelet Analysis and Pattern Recognition, 2007. ICWAPR '07. International Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4244-1065-1
Electronic_ISBN :
978-1-4244-1066-8
Type :
conf
DOI :
10.1109/ICWAPR.2007.4420743
Filename :
4420743
Link To Document :
بازگشت