[Computer-go] Beta-testing: feedback to bot owners

[fastgo]

Nick,

I mistakenly thought the test was only on 9x9. So I connected the 9x9
version, which is compiled to support board size only up to 9. Otherwise I
would have connected the 19x19 version which support all board size up to
19.

As for the cleanup phase, I re-created the sgf from the log files. It seems
that StoneGrid handled it properly.

Please see the attached sgf for the game 3. Black had won. StoneGrid was
taking black here as I read from the logs. And it had two dead stones in the
white's territory. Black had won whether or not the white remove the two
dead pieces.

Thanks a lot for the report.

Thanks,

John


On Fri, Jan 21, 2011 at 6:51 AM, Nick Wedd <nick at maproom.co.uk> wrote:

> This is boring - most of you will want to skip it.
>
> While beta-testing the improved tournament system on KGS, my task was to
> report on the behaviour of the tournament-scheduler.  But I happened to
> notice several things the bots did.  I report on these here.
>
> In the biggest tournament I ran, the komi was set to 7, allowing jigo. It
> seemed that gnugo3pt7 (a pre-MC build of GNU Go, which I ran) understood
> this, but StoneGrid and Orego12 did not.  As a result, gnugo3pt7 got several
> undeserved wins against these stronger programs.
>    I now think that using integer komi is a mistake.  I do not plan to use
> it in future events.  And it will not be used in the computer events in the
> European Go Congress this summer.
>
> The final test I did used 11x11 boards.  When StoneGrid joined its game, it
> immediately and repeatedly disconnected and reconnected.  Indeed, it did
> this so rapidly that I could deduce that Professor Drake lives rather close
> to Portland, Oregon.  StoneGrid had played normally in the previous tests,
> so I guess it dislikes non-standard board sizes.
>
> The clean-up phase was mishandled in at least two games between StoneGrid
> and gnugo3pt7 (rounds 3 and 7).  I am fairly sure that GNU Go does clean-up
> correctly, so I suspect that StoneGrid doesn't.
>
> TimeWaster (one of Aloril's delinquent bots) is somehow able to abuse the
> clean-up system.  At the end of every game, it claims that all its
> opponent's stones are dead, and that its own stone (it never has more than
> one on the board) is alive.  Then the game enters the clean-up phase, there
> is one pass, and the players make their claims again.  This repeats
> indefinitely.
>    My understanding is that this shouldn't be possible.  Once the game has
> entered the clean-up phase, there should be no more claims, all stones still
> on the board when play stops for the second time should be treated as alive.
>
> Nick
> --
> Nick Wedd    nick at maproom.co.uk
> _______________________________________________
> Computer-go mailing list
> Computer-go at dvandva.org
> http://dvandva.org/cgi-bin/mailman/listinfo/computer-go
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://computer-go.org/pipermail/computer-go/attachments/20110121/b1e0acac/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: game-3.sgf
Type: application/sgf
Size: 819 bytes
Desc: not available
URL: <http://computer-go.org/pipermail/computer-go/attachments/20110121/b1e0acac/attachment.bin>