Title :
Development of reinforcement learning methods in control and decision making in the large scale dynamic game environments
Author :
Orafa, S. ; Yazdanpanah, M.J. ; Lucas, C. ; Rahimikian, A. ; Ahmadabadi, M. Nili
Author_Institution :
Control & Intelligent Process. Center of Excellence, Tehran Univ.
Abstract :
In this paper, an analytical comparison is done between dynamic programming and reinforcement learning methods in dynamic two-player games. The emphasis is on the large number of states and actions available for each player and different conflictive optimization objectives of these games that make them complicated in modeling and analysis. Optimization and decision making is done through quantifying a modified Q-learning algorithm. By this method, it is shown that the information processing in large scale-long stage games will take shorter times and will result in lower decision costs whereas dynamic programming methods cannot handle them across long time-horizons
Keywords :
decision theory; dynamic programming; game theory; learning (artificial intelligence); Q-learning algorithm; conflictive optimization objectives; decision making; dynamic programming; dynamic two-player games; large scale dynamic game environments; reinforcement learning; Control system synthesis; Decision making; Dynamic programming; Equations; Game theory; Intelligent control; Large-scale systems; Learning; Optimal control; State-space methods;
Conference_Titel :
Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control, 2006 IEEE
Conference_Location :
Munich
Print_ISBN :
0-7803-9797-5
Electronic_ISBN :
0-7803-9797-5
DOI :
10.1109/CACSD-CCA-ISIC.2006.4776756