A novel entropy based unsupervised Feature Selection algorithm using rough set theory

Feature Selection (FS) is a process, to select features which are more informative. It is one of the important steps in knowledge discovery. The problem is that not all features are important. Some of the features may be redundant, and others may be irrelevant and noisy. The conventional supervised FS methods evaluate various feature subsets using an evaluation function or metric to select only those features which are related to the decision classes of the data under consideration. However, for many data mining applications, decision class labels are often unknown or incomplete, thus indicating the significance of unsupervised feature selection. However, in unsupervised learning, decision class labels are not provided. In this paper, we propose a novel unsupervised entropy based reduct algorithm using rough set theory. The quality of the reduced data is evaluated using WEKA classifier tool. The proposed method is compared with an existing supervised method in order to demonstrate the efficiency of the algorithm.