Title :
Learning rule representations from data
Author :
Apolloni, Bruno ; Brega, Andrea ; Malchiodi, Dario ; Palmas, Giorgio ; Zanaboni, Anna Maria
Author_Institution :
Dipt. di Sci. dell´´Informazione, Univ. degli Studi di Milano
Abstract :
We discuss a procedure which extracts statistical and entropic information from data in order to discover Boolean rules underlying them. We work within a granular computing framework where logical implications between statistics on the observed sample and properties on the whole data population are stressed in terms of both probabilistic and possibilistic measures of the inferred rules. With the main constraint that the class of rules is not known in advance, we split the building of the hypotheses on them in various levels of increasing description complexity, balancing the feasibility of the learning procedure with the understandability and reliability of the formulas that are discovered. We appreciate the entire learning system in terms of truth tables, formula lengths, and computational resources through a set of case studies
Keywords :
Boolean functions; entropy; learning (artificial intelligence); logic design; possibility theory; probability; Boolean rules; entropic information; granular computing; learning rule representations; possibilistic measure; probabilistic measure; truth tables; Data mining; Fuzzy sets; Inference algorithms; Learning systems; Mutual information; Pollution; Rough sets; Statistics; Stress measurement; Upper bound; Algorithmic inference; Boolean formula simplification; computational learning; fuzzy sets; granular computing; mutual information; probably approximately correct (PAC) meditation; rough sets; rule learning; sentry points;
Journal_Title :
Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on
DOI :
10.1109/TSMCA.2006.878987