Title :
Research and Application of a Method for Constructing Decision Forests
Author_Institution :
Zhejiang Inst. of Commun. & Media, Hangzhou
Abstract :
Decision forest (DF) is an implementation of multiple classifier system, which has been introduced to overcome the flaw of a single decision tree. In this paper, a method named the random subspace method (RSM) for constructing DF is investigated. RSM can keep perfect accuracy on training data while having desirable generalization accuracy. Moreover, its accuracy continues to increase as DF becomes larger, exhibiting a characteristic of overtraining resistant. The underlying theory of this model is presented in this paper. A comparison of three combination methods for this model voting, Bayesian method and neural-network is carried out. The power of voting is demonstrated both theoretically and experimentally. As for the application of this method, the superiority of RSM is explored and an advice regarding the size of attribute subsets is given.
Keywords :
decision trees; pattern classification; random processes; trees (mathematics); Bayesian method; decision forests; multiple classifier system; neural network; pattern recognition; random subspace method; single decision tree; Bayesian methods; Classification tree analysis; Decision trees; Genetic algorithms; Pattern classification; Pattern recognition; Stochastic processes; Testing; Training data; Voting; Decision Forest; Pattern recognition; classifier combination; decision tree; stochastic discrimination;
Conference_Titel :
Service Systems and Service Management, 2007 International Conference on
Conference_Location :
Chengdu
Print_ISBN :
1-4244-0885-7
Electronic_ISBN :
1-4244-0885-7
DOI :
10.1109/ICSSSM.2007.4280168
