Title : 
Mobile robot navigation using neural Q-learning
         
        
            Author : 
Yang, Guo-Sheng ; Chen, Er-Kui ; Cheng-Wan An
         
        
            Author_Institution : 
Inst. of Comput. & Inf. Eng., Henan Univ., Kaifeng, China
         
        
        
        
        
        
            Abstract : 
Continuous Q-learning algorithm has been widely used in robotic domains for its simplicity and well-developed theory. In this paper mobile robot navigation using neural Q-learning is processed. Firstly, according to our developed mobile robot CASIA-I and its working environment, an approach is proposed, used to determine the reward/penalty function of Q-learning. Secondly, after analysis of the continuous Q-learning algorithm based on the multi-layer feedforward neural network, a method for computing the weights of the hidden and output layers is given, and mobile robot navigation using neural Q-learning is implemented. At last, experimental results are included to show that the action policy obtained through Q-learning can make the mobile robot reach the destination without obstacle collision.
         
        
            Keywords : 
collision avoidance; feedforward neural nets; learning (artificial intelligence); mobile robots; navigation; neurocontrollers; mobile robot navigation; multilayer feedforward neural network; neural Q-learning; Feedforward neural networks; Infrared sensors; Mobile robots; Multi-layer neural network; Navigation; Neural networks; Robot sensing systems; Robotics and automation; Tactile sensors; Ultrasonic variables measurement;
         
        
        
        
            Conference_Titel : 
Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on
         
        
            Print_ISBN : 
0-7803-8403-2
         
        
        
            DOI : 
10.1109/ICMLC.2004.1380601