A Semi-Supervised Relief Based Feature Extraction Algorithm

Local Feature Extraction (LFE) algorithm is an effective feature extraction method developed in recent years. One of the shortcomings of the current LFE algorithm is that it can only process labeled data, and does not work well when the amount of the labeled data is limited. However, it is usually easy to obtain large amount of unlabeled data but only a few labeled data. In this paper, we propose a new feature extraction algorithm, called Semi-Supervised LFE (SSLFE), which can handle both labeled and unlabeled data to perform feature extraction. In the proposed algorithm, the labeled data are used to maximize the margin and the unlabeled data are used as regulations with respect to the intrinsic geometric structure of the data. The final projection matrix can be obtained by eigenvalue decomposition. Experiments on several datasets demonstrate that SSLFE achieves much higher classification accuracy than LFE.