Title :
Transpositions and move groups in Monte Carlo tree search
Author :
Childs, Benjamin E. ; Brodeur, James H. ; Kocsis, Levente
Author_Institution :
Comput. Sci. Dept., Worcester Polytech. Inst., Worcester, MA
Abstract :
Monte Carlo search, and specifically the UCT (Upper Confidence Bounds applied to Trees) algorithm, has contributed to a significant improvement in the game of Go and has received considerable attention in other applications. This article investigates two enhancements to the UCT algorithm. First, we consider the possible adjustments to UCT when the search tree is treated as a graph (and information amongst transpositions are shared). The second modification introduces move groupings, which may reduce the effective branching factor. Experiments with both enhancements were performed using artificial trees and in the game of Go. From the experimental results we conclude that both exploiting the graph structure and grouping moves may contribute to an increase in the playing strength of game programs using UCT.
Keywords :
Monte Carlo methods; computer games; trees (mathematics); Monte Carlo tree search; artificial trees; effective branching factor; game programs; graph structure; upper confidence bounds; Algorithm design and analysis; Automation; Computer science; Electronic mail; History; Monte Carlo methods; Statistics; Tree data structures; Tree graphs;
Conference_Titel :
Computational Intelligence and Games, 2008. CIG '08. IEEE Symposium On
Conference_Location :
Perth, WA
Print_ISBN :
978-1-4244-2973-8
Electronic_ISBN :
978-1-4244-2974-5
DOI :
10.1109/CIG.2008.5035667