A novel classifier using random sampling and expert knowledge

In this work we investigate several issues in order to improve the performance of decision trees. Firstly, we introduced or adopt a new composite splitting criterion aimed to improve classification accuracy. Secondly, we derive a new pruning technique using expert knowledge, which is able to significantly reduce the size of tree without degrading the classification accuracy. Finally, we implemented our new splitting criterion and pruning technique to form a new decision tree model; Classification Using Randomization and Expert knowledge (CURE). Carried out experiments using 40 UCI datasets on four existing algorithms showed empirical effectiveness of the devised approach.