Title :
Chaos and periodic dynamics in adaptive motion control systems under unknown environment
Author :
Sano, Masaki ; Ochini, S.
Author_Institution :
Res. Inst. of Electr. Commun., Tohoku Univ., Sendai, Japan
Abstract :
Predicting and controlling dynamical systems in a previously unknown environment are difficult but challenging problems for adaptive learning and control. We examine a neuron based reinforcement learning algorithm for prediction and control of ball games such as tennis, where dynamical equations, environment, and the behavior of the opponent player are a priori unavailable. We show that stochastic reinforcement learning with a feedforward RBF network is efficient for real time learning and control. Furthermore, reinforcement learning can adapt and control not only periodic motion but also quasi-periodic, and even chaotic orbits of the ball dynamics
Keywords :
adaptive control; chaos; dynamics; learning (artificial intelligence); motion control; neurocontrollers; radial basis function networks; adaptive learning; adaptive motion control systems; ball games; chaotic orbits; dynamical systems; feedforward RBF network; neuron based reinforcement learning algorithm; periodic dynamics; stochastic reinforcement learning; unknown environment; Adaptive control; Adaptive systems; Chaos; Control systems; Equations; Learning; Motion control; Neurons; Prediction algorithms; Programmable control;
Conference_Titel :
Systems, Man, and Cybernetics, 1999. IEEE SMC '99 Conference Proceedings. 1999 IEEE International Conference on
Conference_Location :
Tokyo
Print_ISBN :
0-7803-5731-0
DOI :
10.1109/ICSMC.1999.814100