DocumentCode
579595
Title
Win/loss States: An efficient model of success rates for simulation-based functions
Author
Basaldúa, Jacques ; Vega, J. Marcos Moreno
Author_Institution
Dept. de Estadistica IO y Comput., Univ. de La Laguna, Santa Cruz de Tenerife, Spain
fYear
2012
fDate
11-14 Sept. 2012
Firstpage
41
Lastpage
46
Abstract
Monte-Carlo Tree Search uses simulation to play out games up to a final state that can be evaluated. It is well known that including knowledge to improve the plausibility of the simulation improves the strength of the program. Learning that knowledge, at least partially, online is a promising research area. This usually implies storing success rates as a number of wins and visits for a huge number of local conditions, possibly millions. Besides storage requirements, comparing proportions of competing patterns can only be done using sound statistical methods, since the number of visits can be anything from zero to huge numbers. There is strong motivation to find a binary representation of a proportion signifying improvement in both storage and speed. Simple ideas have difficulties since the method has to work around some problems such as saturation. Win/Loss States (WLS) are an original, ready to use, open source solution, for representing proportions by an integer state that have already been successfully implemented in computer go.
Keywords
Monte Carlo methods; digital simulation; learning (artificial intelligence); tree searching; Monte-Carlo tree search; binary representation; integer state; knowledge learning; open source solution; proportion representation; simulation-based function; statistical method; storage requirement; success rate model; win-loss state; Computational intelligence; Computers; Conferences; Games; Indexes; Radiation detectors; Table lookup;
fLanguage
English
Publisher
ieee
Conference_Titel
Computational Intelligence and Games (CIG), 2012 IEEE Conference on
Conference_Location
Granada
Print_ISBN
978-1-4673-1193-9
Electronic_ISBN
978-1-4673-1192-2
Type
conf
DOI
10.1109/CIG.2012.6374136
Filename
6374136
Link To Document