[computer-go] Test position set for MC programs

[Gunnar Farnebäck]

Yamato wrote:
 > Thanks Gian-Carlo, Gunnar.
 >
 > Current list of results.
 >
 > GNU Go 3.7.12 level 0          : 24/50
 > GNU Go 3.7.12 level 10         : 34/50
 > GNU Go 3.7.12 level 15         : 37/50
 > GNU Go 3.7.12 mc, 1k           : 30/50
 > GNU Go 3.7.12 mc, 10k          : 31/50
 > GNU Go 3.7.12 mc, 100k         : 38/50
 > GNU Go 3.7.12 mc, light, 1k    : 33/50
 > GNU Go 3.7.12 mc, light, 10k   : 30/50
 > GNU Go 3.7.12 mc, light, 100k  : 25/50
 > GNU Go 3.7.12 mc, mogo, 1k     : 34/50
 > GNU Go 3.7.12 mc, mogo, 10k    : 33/50
 > GNU Go 3.7.12 mc, mogo, 100k   : 35/50
 > Leela 0.3.14, 1k               : 19/50
 > Leela 0.3.14, 10k              : 28/50
 > Leela 0.3.14, 100k             : 36/50
 > Zen 1.5, 1k                    : 19/50
 > Zen 1.5, 10k                   : 22/50
 > Zen 1.5, 100k                  : 24/50
 >
 > Leela seems to have good scalability. 36/50 passes is fine.
 > The results of GNU Go are a bit irregular because of its hybrid
 > strategy. If GNU Go could run on the MC only mode, it might be more
 > interesting, I guess.

Ok, I patched out the contributions from normal move generation in the
final move selection (but there's still some influence on UCT tree
move ordering), giving this list:

                                         Only MC
GNU Go 3.7.12 level 0          : 24/50    -
GNU Go 3.7.12 level 10         : 34/50    -
GNU Go 3.7.12 level 15         : 37/50    -
GNU Go 3.7.12 mc, 1k           : 30/50   14/50
GNU Go 3.7.12 mc, 10k          : 31/50   29/50
GNU Go 3.7.12 mc, 100k         : 38/50   35/50
GNU Go 3.7.12 mc, light, 1k    : 33/50    7/50
GNU Go 3.7.12 mc, light, 10k   : 30/50   14/50
GNU Go 3.7.12 mc, light, 100k  : 25/50   22/50
GNU Go 3.7.12 mc, mogo, 1k     : 34/50   14/50
GNU Go 3.7.12 mc, mogo, 10k    : 33/50   21/50
GNU Go 3.7.12 mc, mogo, 100k   : 35/50   34/50

/Gunnar