Title :
Fuzzy rule mining by fuzzy decision tree induction based on fuzzy feature subset
Author :
Yeung, Daniel S. ; Tsang, Eric C C ; Wang, Xizhao
Author_Institution :
Dept. of Comput., Hong Kong Polytech. Univ., Kowloon, China
Abstract :
Fuzzy decision tree (FDT) induction can be used to generate and mine weighted fuzzy production rules (WFPRs) and the representation power of WFPRs can be enhanced by including several knowledge parameters such as weight and certainty factor. So far, the heuristic used in FDT generation is the entropy-based heuristic which can learn a set of fuzzy rules from examples with the same type of attributes, but it cannot handle data with mixed attributes and cannot capture knowledge parameters of WFPRs. This paper proposes a new heuristic which can not only generate and mine a set of WFPRs from data with mixed attributes with better performance but also capture the knowledge parameters of fuzzy rules. First, a uniform fuzzy representation of training examples with mixed attributes is proposed. Then a new heuristic for generating a FDT to which FPRs are extracted is given by using the fuzzy feature subset. After that, a matching algorithm for classifying an unknown object is presented. Our matching algorithm is shown to have less ambiguity when comparing with another method. Finally, the advantages of our proposed methodology are verified and compared with the Fuzzy ID3 on real-world data.
Keywords :
data mining; decision trees; fuzzy logic; heuristic programming; learning by example; uncertainty handling; Fuzzy ID3; certainty factor; entropy-based heuristic; fuzzy decision tree induction; fuzzy feature subset; fuzzy rule mining; learning by example; mixed attributes; weighted fuzzy production rules; Classification tree analysis; Computer science; Data mining; Decision trees; Fuzzy sets; Induction generators; Information theory; Machine learning; Mathematics; Production;
Conference_Titel :
Systems, Man and Cybernetics, 2002 IEEE International Conference on
Print_ISBN :
0-7803-7437-1
DOI :
10.1109/ICSMC.2002.1173354