[Computer-go] Scraping lower-ranked games from kgs
Petri Pitkanen
petri.t.pitkanen at gmail.com
Fri Nov 13 00:38:28 PST 2015
Yes scraping for large amounts of data from a smallish server is not
really polite. May overload the server. Besides quite inefficient. You
could make a request to owner of site instead. Assuming you can present
good enough reason you might get lucky
2015-11-13 8:39 GMT+02:00 Josef Moudrik <j.moudrik at gmail.com>:
> Hello,
>
> I have a simple script for downloading info (gamelist, list of oponents,
> games) one by one here:
>
> http://repo.or.cz/gostyle.git/blob/HEAD:/kgs/kgs.py
>
> If you want to download more players, you need to search through opponents
> of players you know. But do not spam the kgs server too much please :-)
>
> Regards,
> Josef
>
>
> On Thu, Nov 12, 2015 at 2:35 PM Arthur Cater <arthur.cater at ucd.ie> wrote:
>
>> Hello,
>> I would be interested for research purposes in getting lots of game sgfs
>> of
>> lower-ranked players, to contrast with the high dan and pro games that
>> get put into collections. Even kyu games. I was thinking of getting them
>> from kgs archives.
>>
>> I wonder if anyone already has a script that could (or could be easily
>> adapted to) do this? And would they share?
>>
>> Thanks,
>>
>> Arthur
>>
>> _______________________________________________
>> Computer-go mailing list
>> Computer-go at computer-go.org
>> http://computer-go.org/mailman/listinfo/computer-go
>
>
> _______________________________________________
> Computer-go mailing list
> Computer-go at computer-go.org
> http://computer-go.org/mailman/listinfo/computer-go
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://computer-go.org/pipermail/computer-go/attachments/20151113/d886f563/attachment.html>
More information about the Computer-go
mailing list