Title :
The improved Q-Learning algorithm based on pheromone mechanism for swarm robot system
Author :
Zhiguo Shi ; Jun Tu ; Qiao Zhang ; Xiaomeng Zhang ; Junming Wei
Author_Institution :
Sch. of Comput. & Commun. Eng., Univ. of Sci. & Technol. Beijing, Beijing, China
Abstract :
The reinforcement learning of the robot learning have general applicability in path planning, motion control and other aspects of mobile robot, which not only converges of reinforcement learning but also attributes to the simple implementation of the reinforcement learning, the typical reinforcement learning method is Q-Learning. Some improvements of the shortcomings of the Q-Learning is proposed by using the pheromone mechanism of the ant colony algorithm to solve the information sharing problem in the reinforcement learning system. Finally, the improved Q-Learning algorithm is simulated in the platform of Player/Stage. The results are compared with Q-Learning algorithm and PSO algorithm, which prove that the improved Q-Learning has high efficiency in the path planning of swarm robotics.
Keywords :
ant colony optimisation; distributed control; learning (artificial intelligence); mobile robots; multi-robot systems; particle swarm optimisation; path planning; PSO algorithm; ant colony algorithm; improved Q-learning algorithm; information sharing problem; mobile robot; motion control; particle swarm optimization; path planning; pheromone mechanism; player-stage platform; reinforcement learning; robot learning; swarm robot system; Algorithm design and analysis; Cities and towns; Learning (artificial intelligence); Learning systems; Robot kinematics; Simulation; Distribute reinforcement learning; Pheromone mechanism; Q-Learning; Swarm robotics system;
Conference_Titel :
Control Conference (CCC), 2013 32nd Chinese
Conference_Location :
Xi´an