[computer-go] 9x9 games wanted and the next big challenge

[Rémi Coulom]

Don Dailey wrote:
> On Mon, 2007-07-09 at 10:10 -0700, terry mcintyre wrote:
>   
>> I concur with Christian Nilsson; handicap stones permit the win-loss
>> ratio to approximate 50%,  where it is more sensitive to improvements.
>> As one tweaks the program, the progress would be measurable within a
>> few games, one's handicap would decrease. 
>>
>> Is it possible to tie together the handicap information and the
>> win-loss percentages into a unified ELO-type score? Would an
>> experiment be needed to measure the effect of handicap stones on the
>> probability of winning?   
>>     
>
> I think the common formula is 100 ELO per stone?   I think we could
> start with this guess (or a better one) and after a few weeks of play we
> could do a statistical analysis to see if things are as they should be.
> Then we could make any adjustments if needed.

According to some early experiments I have made on a database of games 
played by humans on KGS, I'd say it is more likely to be 70 or 80 Elo 
points. Also, it is likely to depend on strength. I'll be able to give 
more precise data in a few weeks.

The problem with programs is that GNU Go really does not know how to 
play handicap games. Crazy Stone and, I expect, MC programs in general, 
should handle handicap much better. Crazy Stone played a few handicap 
games against weaker humans on KGS two days ago, and it really plays 
agressive moves when it is behind.

Rémi