Life In 19x19
http://lifein19x19.com/

A new run of KataGo released - strength comparable to ELFv2
http://lifein19x19.com/viewtopic.php?f=18&t=16709
Page 1 of 7

Author:  veikko [ Tue Jun 18, 2019 5:20 am ]
Post subject:  A new run of KataGo released - strength comparable to ELFv2

https://www.reddit.com/r/cbaduk/comment ... and_other/

https://github.com/lightvector/KataGo/releases/tag/v1.1

Author:  lightvector [ Tue Jun 18, 2019 4:52 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Summary:

* New run learns twice as fast as the old LZ130 run and now reaches ELFv2 level at visit parity in about 19 days, and using no more than 27 GPUs for most of the run (19 for early parts, 28 briefly) instead of hundreds or thousands as in Leela Zero/ELF/AlphaZero. Self-play games and training data all released: https://d3dndmfyhecmj0.cloudfront.net/g104/index.html

* Major steps forward on OpenCL and Windows support. More work still to be done, I'm working on it.

* The OpenCL/Windows issue aside, should work fine with Lizzie and other tools at this point (and if not, I should be able to make any fixes quickly and easily if it's just a matter of outputting the data the right way for a tool to read). Capable of also predicting final score and territory heatmap, as soon as any tool wants to add support for how that tool wants to display it.

* Still have many research ideas for how to continue to improve it. I'll be continuing to test these these ideas over the next months, and if any of these ideas test out well, we should be able to do an even better third run.

I'm happy to answer any questions or whatever. Yay.

Author:  spook [ Wed Jun 19, 2019 3:33 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

@lightvector
Wanted to congratulate you and the entire KataGo team with the 1.1 release.
I am convinced that it will have a big impact on the AI study tools.

Installed it this evening on an ubuntu test server. Looks promising.
Will play around with it in the coming days.

PS: are you also "@lightvector" on twitter ?

Author:  lightvector [ Wed Jun 19, 2019 11:16 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Thanks! Seems like the main big remaining obstacles to usability are Windows support and CUDA dependence. Hope to address both of those over the next few weeks.

No, I am not on Twitter at all.

Author:  Bonobo [ Thu Jun 20, 2019 5:39 am ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Very exciting … any chance we can get this for macOS?

Author:  EdLee [ Thu Jun 20, 2019 1:35 pm ]
Post subject: 

Quote:
... for macOS?
Or an OS-indep browser version like deepleela or zbaduk ( greedy :twisted: )

Author:  Bonobo [ Thu Jun 20, 2019 4:31 pm ]
Post subject:  Re:

EdLee wrote:
Quote:
... for macOS?
Or an OS-indep browser version like deepleela or zbaduk ( greedy :twisted: )

… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)

Author:  lightvector [ Thu Jun 20, 2019 5:33 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Bonobo wrote:
Very exciting … any chance we can get this for macOS?


I have a friend who I think has managed to compile it for mac already, so I think the answer is already yes? Let me know if you run into problems, happy to troubleshoot. If you're looking for pre-compiled executables, I'll try to figure that out once the OpenCL implementation is fast enough for real use, since figuring out how to link with CUDA and deal with CUDNN is a headache, even sometimes right on the same OS I do all my development on (linux).

Bonobo wrote:
… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)


Well, I hope whatever dev or devs like to develop sites like that in their spare time find KataGo worth picking up. :)

Author:  Bonobo [ Thu Jun 20, 2019 6:05 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

lightvector wrote:
I have a friend who I think has managed to compile it for mac already, so I think the answer is already yes? Let me know if you run into problems, happy to troubleshoot.
Oh wow, sounds good … but meanwhile I’m elderly and not so adventurous as I once was … so, I’ll wait for click-ready executables :)

Quote:
Bonobo wrote:
… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)


Well, I hope whatever dev or devs like to develop sites like that in their spare time find KataGo worth picking up. :)
Why not talk to Andreas M. Hauenstein about it? His mail address is on the “About” page.

Author:  bernds [ Fri Jun 21, 2019 7:16 am ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

I've pushed some code to the q5go github to support kata-analyze and save/display the score data it reports (it's added to the comment in batch analysis, and the evaluation graph now has a context menu item to switch between score and win rate).

Author:  splee99 [ Fri Jun 21, 2019 5:40 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Compared to ELFv2, Katago's handicap game style is really the best. It can play 5 handicap games ( I haven't test more handicaps yet) without any bad moves (remember ELF's ladder moves?).

Author:  splee99 [ Sat Jun 22, 2019 1:34 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Here is a 4 stone handicap game with Leela 0.11 with 20 second per move time setting. With the same time setting Leela Zero 40b weights have only small chance to win in 3 handicap games. The obvious style of Katago is that it likes to cut and deal with multiple groups properly. It even outsmarts Leela 0.11 in ladder reading.



Attachment:
kata-l-20s-b.sgf [2.28 KiB]
Downloaded 2879 times

Author:  hoa803 [ Thu Jun 27, 2019 6:32 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Here is an example of a fascinating game between LZ and KataGo I played out tonight in Sabaki while working out. Hey, gotta watch something, right? It's like baduk TV!

The hardware was:
AMD Ryzen 2600x
NVIDIA RTX 2060

The settings were as follows:

KataGo 1.1
Code:
C:\KataGo\main.exe
gtp -model C:\KataGo\20b.txt -config C:\KataGo\configs\gtp_example.cfg
time_settings 0 16 1
(all default except numSearchThreads = 16, cudaUseFP16 = true, cudaUseNHWC = true, no limits on playouts/visits, ponderingEnabled = false)


Leela Zero #226
Code:
C:\LeelaZero\LZ017\leelaz.exe
--gtp -r 5 -w C:\LeelaZero\networks\LZ226.gz --noponder
time_settings 0 16 1


I made the first four moves myself, because I didn't want to watch a bunch of 3-3 invasions this time. The game features an early ko and a complicated fight in the center that decides the entire game. Neither engine was sure who was winning until the very end.



Attachments:
LZ226_KataGo1-1_15sec_RTX2060.sgf [2.64 KiB]
Downloaded 2748 times

Author:  lightvector [ Thu Jun 27, 2019 7:33 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

I find high level bot v bot games both confusing and amazing. The midgame fights that break out can become so complicated.

Author:  Bill Spight [ Mon Jul 01, 2019 2:46 am ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Marcel Grünauer wrote:
As far as I understand, KataGo needs CUDA/CuDNN, which requires NVIDIA GPUs, so there might be no way to run the current version of KataGo on Apple hardware (macOS or any other OS), since Macs use Radeon GPUs.


FWIW, my 2014 Macbook Pro has an NVIDIA GPU:

"Chipset Model: NVIDIA GeForce GT 750M"

Author:  amnal [ Mon Jul 01, 2019 11:16 am ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Marcel Grünauer wrote:
In this discussion there has been mention of an OpenCL version, so I assume that doesn't require CUDA etc., right?


That is correct. It will still need an OpenCL device, normally a gpu but also supported by some cpus (although that will be relatively slow).

Author:  splee99 [ Mon Jul 01, 2019 12:35 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

Now this is a strange game between Katago(B) and LZ230(W). Near the end of the game white played F8 so that there was a seki in ko situation.

Image

Both sides think they are losing. Maybe Katago thought the ko was too big? Maybe LZ thought it was a bad ko to start? So at least one of the bots was wrong and finally LZ230 resigned. I hope someone can explain this because I'm not a strong go player.



Attachments:
kata-lz-230-20-2.sgf [3.76 KiB]
Downloaded 2547 times

Author:  yoyoma [ Mon Jul 01, 2019 2:00 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

splee99, it cannot be a seki because White H8 string is dead. White's only option is to start the ko by playing A5, and Black takes first. By the very end I don't see any White ko threats, so Black will win the ko.

For Black maybe doing something earlier to resolve the situation is safer -- either taking the ko (and filling it to make a temporary seki), or filling liberties of H8. But maybe Black calculated White starting the ko isn't dangerous since Black will take first.

Author:  Bill Spight [ Mon Jul 01, 2019 4:24 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

This is an approach ko ( https://senseis.xmp.net/?ApproachKo ). White cannot win this ko. Earlier in the game it may have been better for White to convert this to a direct ko and gain something in exchange for losing the ko. FWIW, I am unaware of any bot ever playing this strategy. I am not sure that current bots could learn it, but in any case they might be able to read the ko fight out and play it.

Author:  splee99 [ Mon Jul 01, 2019 5:57 pm ]
Post subject:  Re: A new run of KataGo released - strength comparable to EL

You are right it is a complex situation. However, Katago thought b was losing (w can play A5 to make it a direct ko). That's a little confusing to me. By the way, white just need to find a small ko threat to win the game. I would think it would be better than sitting there and doing nothing about the ko.

Page 1 of 7 All times are UTC - 8 hours [ DST ]
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/