Title :
On compatible priors for Bayesian networks
Author :
Cowell, Robert G.
Author_Institution :
Sch. of Math. Actuarial Sci. & Stat., City Univ., London, UK
fDate :
9/1/1996 12:00:00 AM
Abstract :
Given a Bayesian network of discrete random variables with a hyper-Dirichlet prior, a method is proposed for assigning Dirichlet priors to the conditional probabilities of structurally different networks. It defines a distance measure between priors which is to be minimized for the assignment process. Intuitively one would expect that if two models priors are to qualify as being `close´ in some sense, then their posteriors should also be nearby after an observation. However one does not know in advance what will be observed next. Thus we are led to propose an expectation of Kullback-Leibler distances over all possible next observations to define a measure of distance between priors. In conjunction with the additional assumptions of global and local independence of the parameters, a number of theorems emerge which are usually taken as reasonable assumptions in the Bayesian network literature. A simple example is given to illustrate the technique
Keywords :
Bayes methods; graph theory; learning systems; optimisation; pattern matching; probability; Bayesian networks; Dirichlet priors; Kullback-Leibler distances; chain graphs; conditional probability; discrete random variables; global independence; local independence; optimisation; Algorithm design and analysis; Bayesian methods; Computational Intelligence Society; Databases; Notice of Violation; Predictive models; Random variables; Statistics;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on