Title :
Proposing a reinforcement learning based approach for feature selection
Author :
Fard, Seyed Mehdi Hazrati ; Hamzeh, Ali ; Hashemi, SayedMasoud
Author_Institution :
Dept. of Comput. Sci. & Eng. & IT, Shiraz Univ., Shiraz, Iran
Abstract :
In supervised learning scenarios, feature selection has been studied widely in the literature. Here, feature selection is considered as an empirical strategy of restricting state space and lessen the complexity of hypothesis. In this work we introduce the environment as a one player game and improve a reinforcement learning method to traverse the state space and learn from experiments. In this way we exert a Monte Carlo based method, and adapt the problem with the requirements of such procedure. As we need to reward each action and evaluate the states, we employ SVM classifier according to selected features. Moreover SVM is used to determine the appropriation of selected features and evaluate the final subset of features. At last we compare this work with the state of the art methods. Experimental results demonstrate the effectiveness and efficiency of our algorithm.
Keywords :
Monte Carlo methods; combinatorial mathematics; game theory; learning (artificial intelligence); mathematics computing; optimisation; support vector machines; Monte Carlo based method; SVM classifier; combinatorial optimization problem; feature selection; less hypothesis complexity; one-player game; reinforcement learning based approach; state space restriction strategy; supervised learning scenarios; Algorithm design and analysis; Classification algorithms; Complexity theory; Fuses; Learning; Monte Carlo methods; Support vector machines; Feature Selection; Markov Decision Process; Monte Carlo; One-player Game; Reinforcement Learning;
Conference_Titel :
Artificial Intelligence and Signal Processing (AISP), 2012 16th CSI International Symposium on
Conference_Location :
Shiraz, Fars
Print_ISBN :
978-1-4673-1478-7
DOI :
10.1109/AISP.2012.6313777