Title :
Improving the accomplishment of a neural network based agent for draughts that operates in a distributed learning environment
Author :
Tomaz, Lidia B. P. ; Julia, R.M.S. ; Barcelos, Ayres R. A.
Author_Institution :
Comput. Sci. Dept., Fed. Univ. of Uberlandia, Uberlandia, Brazil
Abstract :
This article presents an extension to the system D-VisionDraughts: a draughts player agent based on a MultiLayer Perceptron Neural Network which operates in a distributed environment, and in a manner which distinguishes it from the current world champion Chinook, it learns without human supervision. The network weights are updated by Temporal Differences Methods using self-play with cloning technique. The best move is chosen by the parallel Alpha-Beta search algorithm called Young Brothers Wait Concept. The representation of the game board states is based on the NET-FEATUREMAP techniques (functions describing features inherent to Draughts game). This paper investigates the improvement obtained by D-VisionDraughts through the insertion of new features that allow a more precise representation of the board states. Further, the authors show to what extent the addition of new processors compensates the increase in training time that would be an obvious consequence of the optimization of the board state representation.
Keywords :
computer games; distributed processing; learning (artificial intelligence); multilayer perceptrons; search problems; software agents; D-VisionDraughts; Draughts game; Draughts player agent; NET-FEATUREMAP techniques; Young Brothers Wait Concept; board state representation; cloning technique; distributed learning environment; game board; multilayer perceptron neural network; network weights; neural network based agent; parallel alpha-beta search algorithm; temporal differences methods; world champion Chinook; Artificial neural networks; Cloning; Games; Neurons; Program processors; Training; Distributed Search Algorithm YBWC; Neural Networks; Reinforcement Learning in Draughts; Representation of the State Spaces;
Conference_Titel :
Information Reuse and Integration (IRI), 2013 IEEE 14th International Conference on
Conference_Location :
San Francisco, CA
DOI :
10.1109/IRI.2013.6642481