[computer-go] 19x19 Study - prior in bayeselo, and KGS study

[dhillismail at netscape.net]

> From: Don Dailey <drdailey at cox.net>
> ...
> > Rémi Coulom wrote:
> > ...
> > Instead of playing UCT bot vs UCT bot, I am thinking about running a
> > scaling experiment against humans on KGS. I'll probably start with 2k,
> > 8k, 16k, and 32k playouts.

> That would be a great experiment.   There is only 1 issue here and
> that's time control.   I would suggest the test is more meaningful if
> you use the same time-control for all play-out levels, even if Crazy
> Stone plays really fast.    This is because the ELO curve for humans is
> also based on thinking time.  

> If you set the time control at just the rate the program needs to use
> all it's time,    you might very well find the program plays better at
> fast time controls, it would be meaningless even as a rough measurement
> of ELO strength.


In addition to having all versions of the program use the same time control, I think it would be best if they all made their moves at the same rate. When humans play against a bot playing at a fast tempo, they tend to speed up themselves regardless of the time limits. The human's pondering is also a factor.

I've noticed this in games on KGS; a lot of people lose games with generous time limits because they, rashly, try to keep up with my dumb but very fast bot and make blunders.

- Dave Hillis



________________________________________________________________________
More new features than ever.  Check out the new AIM(R) Mail ! - http://webmail.aim.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://computer-go.org/pipermail/computer-go/attachments/20080129/4ac5950f/attachment.htm