Life In 19x19

Hello everyone,

as I finally managed to find some time to get a bot running on CGOS, I thought it might be nice to have a place to share information and tips on how to set up different bots with CGOS or provide hardware information.

For those, who don't about CGOS yet: It's a computer go server that allows free access for bots to compete against each other with 15min sudden death time limits on 19x19.

Main page: http://www.yss-aya.com/cgos/
Current standings: http://www.yss-aya.com/cgos/19x19/standings.html
BayesElo standings after at least 100 games: http://www.yss-aya.com/cgos/19x19/bayes.html

The main page gives a good overview, but if there are any questions, feel free to ask here.


Right now, personally I'm running the Rn4204_4790_980Ti bot. That's Rn 4.20.4 from https://github.com/zakki/Ray on an i7 4790k, GTX 980Ti and 16GB RAM on Windows 10, with the following command line configuration:

ray.exe --time 880 --size 19 --thread 8 --komi 7.5 --superko --tree-size 262144 --no-debug --no-early-pass

Pondering is disabled as there is a bug in 4.20.4 that leads to timeouts otherwise. I'm looking to add --reuse-subtree for the next matches. The tree size is already at max for the amount of RAM available. The time is set at 880 seconds to leave a bit of buffer for the 900 seconds time limit, but I assume this is actually overridden by GTP by the server.
Also, I'm not using the TCL script, but the Python client, as Rn doesn't completely obey the --no-debug flag and outputs some debug info on move generation when running in GPU mode, which confuses the client and terminates the session. I edited the Python client to filter out anything but the actual move response so I could run Rn with GPU.
As the CPU only has 4 real cores, I ran with 4 threads on some test sessions, but Rn would only utilize the CPU up to about 70%, and I had to bump the thread count up to 8 to get 100% utilization.

I'm looking forward to the next Leela release and giving that a spin on CGOS.


Some bot information

Rn4204_4790_980Ti
Bot: Rn 4.20.4 - https://github.com/zakki/Ray
Operator: Satorian
Hardware: i7 4790k, GTX 980Ti, 16GB RAM
OS: Windows 10
Params: ray.exe --time 880 --size 19 --thread 8 --komi 7.5 --superko --tree-size 262144 --no-debug --no-early-pass

LeelaLight 1Thread NoGPU 10.000 playouts ELO 2811
LeelaGPU 4Threads GPU (GTX 750Ti) 50.000 playouts ELO 3063 (+252)
LeelaMax 8Threads GPU (GTX 1070) 100.000 playouts ELO 3314 (+251) (+503)
Bot: Leela - https://sjeng.org/leela.html
Operator: kris
Hardware: CPU i7 2600K, 16GB RAM

Rn.4.20.4-1c1g - 3417 Elo
Bot: Rn 4.20.4 - https://github.com/zakki/Ray
Operator: cyan
Hardware: GTX 1060

Leela-0.10.5-16t1g
Bot: Leela 0.10.5 - Pre-release version - https://sjeng.org/leela.html
Operator: roy7
HardwareRyzen 1700 and a 1080Ti

Hi,

I'm a complete noob with CGOS so could you explain how to run Leela 0.10.0 on this server? I tried to look at the website but it was stil too dificult.

Thanks.

Roy7 was running Leela 0.10.5 under the account Leela-0.10.5-16t1g, and got 3764 Elo in BayesElo. Let's try to beat his record!

Hi! I think Satorian's idea is great.
Here are my results from CGOS with Leela 0.10

CPU I7-2600K 16GB RAM:
LeelaLight 1Thread NoGPU 10.000 playouts ELO 2811
LeelaGPU 4Threads GPU (GTX 750Ti) 50.000 playouts ELO 3063 (+252)
LeelaMax 8Threads GPU (GTX 1070) 100.000 playouts ELO 3314 (+251) (+503)

Waiting for others...

PS: I'm curious about Ashley and Annette

Please note if you run Leela on cgos you need to approximate the Tromp Taylor rules by changing the cgos client to send kgs-genmove_cleanup instead of genmove. This way all dead stones will get removed.

For the 100 games I ran the only option was no pondering. I have a Ryzen 1700 and a 1080Ti. That's the machine behind RoyalLeela on OGS.

GTX 1060:
Rn.4.20.4-1c1g - 3417 Elo

tartaric wrote:Hi,

I'm a complete noob with CGOS so could you explain how to run Leela 0.10.0 on this server? I tried to look at the website but it was stil too dificult.

Thanks.

I'll try to setup Leela myself next week and would then post a .bat and modified .tcl (according to Roy7's info) with all needed links to get it running.

Cyan wrote:Roy7 was running Leela 0.10.5 under the account Leela-0.10.5-16t1g, and got 3764 Elo in BayesElo. Let's try to beat his record!

Hah, I won't get there with my current hardware or freely available versions. I'm looking forward to the next Leela release and will run it on Ubuntu as it seems to perform better there. I'm happy though Rn 4.20.4 managed to beat Zen 15.3 1c1g once on my hardware.

kris wrote:Hi! I think Satorian's idea is great.
Here are my results from CGOS with Leela 0.10

CPU I7-2600K 16GB RAM:
LeelaLight 1Thread NoGPU 10.000 playouts ELO 2811
LeelaGPU 4Threads GPU (GTX 750Ti) 50.000 playouts ELO 3063 (+252)
LeelaMax 8Threads GPU (GTX 1070) 100.000 playouts ELO 3314 (+251) (+503)

Waiting for others...

PS: I'm curious about Ashley and Annette

Awesome! Thanks for the info. I'll try to collect most of it in the first post.

Please note if you run Leela on cgos you need to approximate the Tromp Taylor rules by changing the cgos client to send kgs-genmove_cleanup instead of genmove. This way all dead stones will get removed.

For the 100 games I ran the only option was no pondering. I have a Ryzen 1700 and a 1080Ti. That's the machine behind RoyalLeela on OGS.

Thanks for the info! Much appreciated!

I'm thinking about switching towards a different naming scheme for my bot operations. Something like

L19_<nickname>_<botname>_v<configuration_version>

and then putting the info on hardware, bot version and paramters in a table here. That would allow others to easily identify a bot and get a bit more info. Perhaps the programmers would also be able to glean a bit more from that, knowing that they can look everything up here.

Thanks for your help Satorian for running Leela on CGS! I'm waiting impatiently for it.

tartaric wrote:Thanks for your help Satorian for running Leela on CGS! I'm waiting impatiently for it.

OK, do the following:

Download Leela's GTP version: https://sjeng.org/dl/Leela0100GTP.zip

After unzipping, download http://www.equi4.com/pub/tk/tclkitsh-win32.upx.exe and put the file in the same directory as Leela GTP.

Then download the appended ZIP and extract it into the same directory. Edit config.txt if you want to make changes to the given bot name or the password or want to change any of the parameters, like thread count. After saving your changes, run the run_leela_cgos.bat.

There should be a lot of text info and a time countdown, when the next round of bot matches is going to start. If you wish to do so, you can watch the bots play their matches with http://cgos.boardspace.net/software/cgo ... indows.zip

Whoever is running Rayn.6c-0g set the resignation threshold to 0 via ray-param, which makes the endgame look quite silly. Perhaps even something like 0.05 would be more reasonable.

OK, do the following: ...

Woaw !!! Thanks, it works with my computer (Win 10)

If you wish to do so, you can watch the bots play their matches with ...

To make it work and actually show "my" game , I had to type cgosview-win32.exe yss-aya.com 6819 from a folder containing cgosview-win32


I'm looking forward to experimenting with the parameters

Satorian wrote:

tartaric wrote:Thanks for your help Satorian for running Leela on CGS! I'm waiting impatiently for it.

OK, do the following:

Download Leela's GTP version: https://sjeng.org/dl/Leela0100GTP.zip

After unzipping, download http://www.equi4.com/pub/tk/tclkitsh-win32.upx.exe and put the file in the same directory as Leela GTP.

Then download the appended ZIP and extract it into the same directory. Edit config.txt if you want to make changes to the given bot name or the password or want to change any of the parameters, like thread count. After saving your changes, run the run_leela_cgos.bat.

There should be a lot of text info and a time countdown, when the next round of bot matches is going to start. If you wish to do so, you can watch the bots play their matches with http://cgos.boardspace.net/software/cgo ... indows.zip

Thanks Satorian! Just one more question: I don't know the commands of Leela? What should I put in the .txt file to reach the maximum power of Leela? Shouldn't I use a pondering command? This is my species: https://ibb.co/i6MSrv

The CPU: https://ibb.co/c4Zada

Thanks for your help again!

Satorian wrote:

tartaric wrote:Thanks for your help Satorian for running Leela on CGS! I'm waiting impatiently for it.

OK, do the following:

Download Leela's GTP version: https://sjeng.org/dl/Leela0100GTP.zip

After unzipping, download http://www.equi4.com/pub/tk/tclkitsh-win32.upx.exe and put the file in the same directory as Leela GTP.

Then download the appended ZIP and extract it into the same directory. Edit config.txt if you want to make changes to the given bot name or the password or want to change any of the parameters, like thread count. After saving your changes, run the run_leela_cgos.bat.

There should be a lot of text info and a time countdown, when the next round of bot matches is going to start. If you wish to do so, you can watch the bots play their matches with http://cgos.boardspace.net/software/cgo ... indows.zip

Thanks! It works.

In your config - you don't specify max time to think? As I understand games limited with 15 min absolute time. Is it fine?

cgosviewer just shows me results of games… I can't watch anything live.