DocumentCode
607885
Title
Implementation of Reinforcement Learning by transfering sub-goal policies in robot navigation
Author
Gokce, B. ; Akin, H.L.
Author_Institution
Bilgisayar Muhendisligi Bolumu, Bogazici Univ., Istanbul, Turkey
fYear
2013
fDate
24-26 April 2013
Firstpage
1
Lastpage
4
Abstract
Although Reinforcement Learning (RL) is one of the most popular learning methods, it suffers from the curse of dimensionality. If the state and action domains of the problem are immense, the learning rate of the agent decreases dramatically and eventually the agent loses the ability to learn. In order to eliminate the effects of the curse of the dimensionality, researchers typically concentrate on the methods that reduce the complexity of the problems. While some of them model the problem in a hierarchical manner, the others try to transfer the knowledge obtained during the learning process of simpler tasks. While learning from scratch ignores the previous experiences, transferring full knowledge may mislead the agent because of the conflicting requirements. The main goal of this study is to improve the learning rate of the agent by transferring the relevant parts of the knowledge acquired as a result of previous experiences. The main contribution of this study is to merge these two approaches to transfer only the relevant knowledge in a setting. The proposed method is tested on a robot navigation task in a simulated roombased environment.
Keywords
learning (artificial intelligence); learning systems; navigation; robots; action domain; agent learning rate; knowledge transfer; learning method; learning process; reinforcement learning; robot navigation task; room based environment; state domain; subgoal policy transfer; Computer science; Conferences; Electronic mail; Learning (artificial intelligence); Learning systems; Navigation; Robots; Hierarchical Reinforcement Learning; Reinforcement Learning; Robot Navigation; Transfer Learning;
fLanguage
English
Publisher
ieee
Conference_Titel
Signal Processing and Communications Applications Conference (SIU), 2013 21st
Conference_Location
Haspolat
Print_ISBN
978-1-4673-5562-9
Electronic_ISBN
978-1-4673-5561-2
Type
conf
DOI
10.1109/SIU.2013.6531546
Filename
6531546
Link To Document