DocumentCode :
2579646
Title :
Q learning for mobile robot navigation in indoor environment
Author :
Tamilselvi, D. ; Shalinie, S. Mercy ; Nirmala, G.
Author_Institution :
Dept. of Comput. Sci. & Eng., Thiagarajar Coll. of Eng., Madurai, India
fYear :
2011
fDate :
3-5 June 2011
Firstpage :
324
Lastpage :
329
Abstract :
This Proposed Reinforcement learning supports for optimal path selection for Mobile Robot Navigation in an indoor grid (10×10) environment. Without Prior knowledge in the environment, mobile robot calculates Q-values using current and future discounted reward in each time step. Based on the reinforcement, mobile robot learns the environment, selects the navigation path to reach the goal. Markov Decision Process (MDP) supports for optimal path selection among the paths values calculated through reinforcement learning. Simulation experiments are performed with different positions in the environment. From the start position of grid cell value 10, to reach the goal position 100, with learning rate 0.5 and the Q-value is 70.78. MDP provides the optimal path based on the highest Q-value among the four directions in a grid cell such as 100.00, 125.00, 0.00, 83.33 in the grid cell 21 (one step left direction) and chooses the 100.00 for a single step. After the entire learning environment the Q-value 206.780 is achieved for the learning rate 0.7 for the learning path from grid cell 25 to goal position 100. The learning rate makes the optimized path selection in proposed environment. The optimized path cost of 1083.19 without obstacle cost is for the proposed simulation grid environment.
Keywords :
Markov processes; decision theory; intelligent robots; learning (artificial intelligence); mobile robots; path planning; Markov decision process; Q learning; indoor grid environment; mobile robot navigation; optimal path selection; reinforcement learning support; Indoor environments; Learning; Markov processes; Mobile robots; Navigation; Shape; Learning rate; Markov Decision Process; Mobile robot navigation; Q-values; Reinforcement Learning;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Recent Trends in Information Technology (ICRTIT), 2011 International Conference on
Conference_Location :
Chennai, Tamil Nadu
Print_ISBN :
978-1-4577-0588-5
Type :
conf
DOI :
10.1109/ICRTIT.2011.5972477
Filename :
5972477
Link To Document :
بازگشت