Title :
Proposed particle-filtering method for reinforcement learning
Author :
Notsu, Akira ; Honda, Katsuhiro ; Ichihashi, Hidetomo
Author_Institution :
Osaka Prefecture Univ., Sakai, Japan
Abstract :
We propose a novel action-search particle-filtering algorithm for reinforcement learning processes. This algorithm is designed to perform search domain reduction and heuristic space segmentation. In this method, each action space is divided into several new segments using particles. Appropriate search domain reduction can minimize learning time and enable the recognition of the evolutionary process of learning. In a numerical experiment, the proposed filtering method is applied to a single pendulum simulation in order to demonstrate the adaptability of this simulation model.
Keywords :
learning (artificial intelligence); particle filtering (numerical methods); pendulums; simulation; action-search particle-filtering algorithm; heuristic space segmentation; learning evolutionary process; reinforcement learning process; search domain reduction; single pendulum simulation; Adaptation models; Approximation methods; Genetic algorithms; Learning; Markov processes; Numerical models; particle-filter; reinforcement learning; space segmentation;
Conference_Titel :
Fuzzy Systems (FUZZ), 2011 IEEE International Conference on
Conference_Location :
Taipei
Print_ISBN :
978-1-4244-7315-1
Electronic_ISBN :
1098-7584
DOI :
10.1109/FUZZY.2011.6007337