Title :
Using a Local Discovery Ant Algorithm for Bayesian Network Structure Learning
Author :
Pinto, Pedro C. ; Nägele, Andreas ; Dejori, Mathäus ; Runkler, Thomas A. ; Sousa, João M C
Author_Institution :
Corp. Technol. Inf. & Commun., Siemens AG, Munich, Germany
Abstract :
Bayesian networks (BNs) are knowledge representation tools capable of representing dependence or independence relationships among random variables. Learning the structure of BNs from datasets has received increasing attention in the last two decades, due to the BNs´ capacity of providing good inference models and discovering the structure of complex domains. One approach for BNs´ structure learning from data is to define a scoring metric that evaluates the quality of the candidate networks, given a dataset, and then apply an optimization procedure to explore the set of candidate networks. Among the most frequently used optimization methods for BN score-based learning is greedy hill climbing (GHC) search. This paper proposes a new local discovery ant colony optimization (ACO) algorithm and a hybrid algorithm max-min ant colony optimization (MMACO), based on the local discovery algorithm max-min parents and children (MMPC) and ACO to learn the structure of a BN. In MMACO, MMPC is used to construct the skeleton of the BN and ACO is used to orientate the skeleton edges, thus returning the final structure. The algorithms are applied to several sets of benchmark networks and are shown to outperform the GHC and simulated annealing algorithms.
Keywords :
belief networks; greedy algorithms; inference mechanisms; learning (artificial intelligence); minimax techniques; search problems; simulated annealing; Bayesian network structure learning; benchmark network; greedy hill climbing search; hybrid algorithm max-min ant colony optimization; inference model; knowledge representation tool; local discovery ant algorithm; optimization method; score-based learning; simulated annealing algorithm; Ant colony optimization; Bayesian methods; Communications technology; Graphical models; Higher order statistics; Knowledge representation; Optimization methods; Random variables; Simulated annealing; Skeleton; Ant colony optimization (ACO); Bayesian networks (BNs); local discovery; meta-heuristics; structure learning;
Journal_Title :
Evolutionary Computation, IEEE Transactions on
DOI :
10.1109/TEVC.2009.2024142