It is currently Thu Mar 28, 2024 3:12 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 127 posts ]  Go to page 1, 2, 3, 4, 5 ... 7  Next
Author Message
Offline
 Post subject: A new run of KataGo released - strength comparable to ELFv2
Post #1 Posted: Tue Jun 18, 2019 5:20 am 
Beginner

Posts: 11
Liked others: 11
Was liked: 3
Rank: OGS 3k
https://www.reddit.com/r/cbaduk/comment ... and_other/

https://github.com/lightvector/KataGo/releases/tag/v1.1


This post by veikko was liked by: Bonobo
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #2 Posted: Tue Jun 18, 2019 4:52 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
Summary:

* New run learns twice as fast as the old LZ130 run and now reaches ELFv2 level at visit parity in about 19 days, and using no more than 27 GPUs for most of the run (19 for early parts, 28 briefly) instead of hundreds or thousands as in Leela Zero/ELF/AlphaZero. Self-play games and training data all released: https://d3dndmfyhecmj0.cloudfront.net/g104/index.html

* Major steps forward on OpenCL and Windows support. More work still to be done, I'm working on it.

* The OpenCL/Windows issue aside, should work fine with Lizzie and other tools at this point (and if not, I should be able to make any fixes quickly and easily if it's just a matter of outputting the data the right way for a tool to read). Capable of also predicting final score and territory heatmap, as soon as any tool wants to add support for how that tool wants to display it.

* Still have many research ideas for how to continue to improve it. I'll be continuing to test these these ideas over the next months, and if any of these ideas test out well, we should be able to do an even better third run.

I'm happy to answer any questions or whatever. Yay.


This post by lightvector was liked by 7 people: Bill Spight, Bonobo, dfan, ez4u, Gomoto, MikeKyle, Waylon
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #3 Posted: Wed Jun 19, 2019 3:33 pm 
Lives with ko
User avatar

Posts: 151
Location: Belgium
Liked others: 11
Was liked: 48
Rank: 2d
KGS: LordVader
@lightvector
Wanted to congratulate you and the entire KataGo team with the 1.1 release.
I am convinced that it will have a big impact on the AI study tools.

Installed it this evening on an ubuntu test server. Looks promising.
Will play around with it in the coming days.

PS: are you also "@lightvector" on twitter ?

_________________
Enjoy LeeLaZero and KataGo from your webbrowser, without installing anything !
https://www.zbaduk.com


This post by spook was liked by: lightvector
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #4 Posted: Wed Jun 19, 2019 11:16 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
Thanks! Seems like the main big remaining obstacles to usability are Windows support and CUDA dependence. Hope to address both of those over the next few weeks.

No, I am not on Twitter at all.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #5 Posted: Thu Jun 20, 2019 5:39 am 
Oza
User avatar

Posts: 2221
Location: Germany
Liked others: 8262
Was liked: 924
Rank: OGS 9k
OGS: trohde
Universal go server handle: trohde
Very exciting … any chance we can get this for macOS?

_________________
“The only difference between me and a madman is that I’m not mad.” — Salvador Dali ★ Play a slooooow correspondence game with me on OGS? :)

Top
 Profile  
 
Offline
 Post subject:
Post #6 Posted: Thu Jun 20, 2019 1:35 pm 
Honinbo
User avatar

Posts: 8859
Location: Santa Barbara, CA
Liked others: 349
Was liked: 2076
GD Posts: 312
Quote:
... for macOS?
Or an OS-indep browser version like deepleela or zbaduk ( greedy :twisted: )

Top
 Profile  
 
Offline
 Post subject: Re:
Post #7 Posted: Thu Jun 20, 2019 4:31 pm 
Oza
User avatar

Posts: 2221
Location: Germany
Liked others: 8262
Was liked: 924
Rank: OGS 9k
OGS: trohde
Universal go server handle: trohde
EdLee wrote:
Quote:
... for macOS?
Or an OS-indep browser version like deepleela or zbaduk ( greedy :twisted: )

… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)

_________________
“The only difference between me and a madman is that I’m not mad.” — Salvador Dali ★ Play a slooooow correspondence game with me on OGS? :)

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #8 Posted: Thu Jun 20, 2019 5:33 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
Bonobo wrote:
Very exciting … any chance we can get this for macOS?


I have a friend who I think has managed to compile it for mac already, so I think the answer is already yes? Let me know if you run into problems, happy to troubleshoot. If you're looking for pre-compiled executables, I'll try to figure that out once the OpenCL implementation is fast enough for real use, since figuring out how to link with CUDA and deal with CUDNN is a headache, even sometimes right on the same OS I do all my development on (linux).

Bonobo wrote:
… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)


Well, I hope whatever dev or devs like to develop sites like that in their spare time find KataGo worth picking up. :)


This post by lightvector was liked by: Bonobo
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #9 Posted: Thu Jun 20, 2019 6:05 pm 
Oza
User avatar

Posts: 2221
Location: Germany
Liked others: 8262
Was liked: 924
Rank: OGS 9k
OGS: trohde
Universal go server handle: trohde
lightvector wrote:
I have a friend who I think has managed to compile it for mac already, so I think the answer is already yes? Let me know if you run into problems, happy to troubleshoot.
Oh wow, sounds good … but meanwhile I’m elderly and not so adventurous as I once was … so, I’ll wait for click-ready executables :)

Quote:
Bonobo wrote:
… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)


Well, I hope whatever dev or devs like to develop sites like that in their spare time find KataGo worth picking up. :)
Why not talk to Andreas M. Hauenstein about it? His mail address is on the “About” page.

_________________
“The only difference between me and a madman is that I’m not mad.” — Salvador Dali ★ Play a slooooow correspondence game with me on OGS? :)

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #10 Posted: Fri Jun 21, 2019 7:16 am 
Lives with ko

Posts: 259
Liked others: 46
Was liked: 116
Rank: 2d
I've pushed some code to the q5go github to support kata-analyze and save/display the score data it reports (it's added to the comment in batch analysis, and the evaluation graph now has a context menu item to switch between score and win rate).


This post by bernds was liked by: ez4u
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #11 Posted: Fri Jun 21, 2019 5:40 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
Compared to ELFv2, Katago's handicap game style is really the best. It can play 5 handicap games ( I haven't test more handicaps yet) without any bad moves (remember ELF's ladder moves?).

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #12 Posted: Sat Jun 22, 2019 1:34 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
Here is a 4 stone handicap game with Leela 0.11 with 20 second per move time setting. With the same time setting Leela Zero 40b weights have only small chance to win in 3 handicap games. The obvious style of Katago is that it likes to cut and deal with multiple groups properly. It even outsmarts Leela 0.11 in ladder reading.



Attachment:
kata-l-20s-b.sgf [2.28 KiB]
Downloaded 2864 times


This post by splee99 was liked by 3 people: lightvector, Uberdude, Waylon
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #13 Posted: Thu Jun 27, 2019 6:32 pm 
Beginner

Posts: 19
Liked others: 0
Was liked: 2
Here is an example of a fascinating game between LZ and KataGo I played out tonight in Sabaki while working out. Hey, gotta watch something, right? It's like baduk TV!

The hardware was:
AMD Ryzen 2600x
NVIDIA RTX 2060

The settings were as follows:

KataGo 1.1
Code:
C:\KataGo\main.exe
gtp -model C:\KataGo\20b.txt -config C:\KataGo\configs\gtp_example.cfg
time_settings 0 16 1
(all default except numSearchThreads = 16, cudaUseFP16 = true, cudaUseNHWC = true, no limits on playouts/visits, ponderingEnabled = false)


Leela Zero #226
Code:
C:\LeelaZero\LZ017\leelaz.exe
--gtp -r 5 -w C:\LeelaZero\networks\LZ226.gz --noponder
time_settings 0 16 1


I made the first four moves myself, because I didn't want to watch a bunch of 3-3 invasions this time. The game features an early ko and a complicated fight in the center that decides the entire game. Neither engine was sure who was winning until the very end.



Attachments:
LZ226_KataGo1-1_15sec_RTX2060.sgf [2.64 KiB]
Downloaded 2732 times

This post by hoa803 was liked by: lightvector
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #14 Posted: Thu Jun 27, 2019 7:33 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
I find high level bot v bot games both confusing and amazing. The midgame fights that break out can become so complicated.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #15 Posted: Mon Jul 01, 2019 2:46 am 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Marcel Grünauer wrote:
As far as I understand, KataGo needs CUDA/CuDNN, which requires NVIDIA GPUs, so there might be no way to run the current version of KataGo on Apple hardware (macOS or any other OS), since Macs use Radeon GPUs.


FWIW, my 2014 Macbook Pro has an NVIDIA GPU:

"Chipset Model: NVIDIA GeForce GT 750M"

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #16 Posted: Mon Jul 01, 2019 11:16 am 
Lives in gote

Posts: 589
Liked others: 0
Was liked: 114
Rank: 2 dan
Marcel Grünauer wrote:
In this discussion there has been mention of an OpenCL version, so I assume that doesn't require CUDA etc., right?


That is correct. It will still need an OpenCL device, normally a gpu but also supported by some cpus (although that will be relatively slow).

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #17 Posted: Mon Jul 01, 2019 12:35 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
Now this is a strange game between Katago(B) and LZ230(W). Near the end of the game white played F8 so that there was a seki in ko situation.

Image

Both sides think they are losing. Maybe Katago thought the ko was too big? Maybe LZ thought it was a bad ko to start? So at least one of the bots was wrong and finally LZ230 resigned. I hope someone can explain this because I'm not a strong go player.



Attachments:
kata-lz-230-20-2.sgf [3.76 KiB]
Downloaded 2532 times
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #18 Posted: Mon Jul 01, 2019 2:00 pm 
Lives in gote

Posts: 653
Location: Austin, Texas, USA
Liked others: 54
Was liked: 216
splee99, it cannot be a seki because White H8 string is dead. White's only option is to start the ko by playing A5, and Black takes first. By the very end I don't see any White ko threats, so Black will win the ko.

For Black maybe doing something earlier to resolve the situation is safer -- either taking the ko (and filling it to make a temporary seki), or filling liberties of H8. But maybe Black calculated White starting the ko isn't dangerous since Black will take first.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #19 Posted: Mon Jul 01, 2019 4:24 pm 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
This is an approach ko ( https://senseis.xmp.net/?ApproachKo ). White cannot win this ko. Earlier in the game it may have been better for White to convert this to a direct ko and gain something in exchange for losing the ko. FWIW, I am unaware of any bot ever playing this strategy. I am not sure that current bots could learn it, but in any case they might be able to read the ko fight out and play it.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #20 Posted: Mon Jul 01, 2019 5:57 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
You are right it is a complex situation. However, Katago thought b was losing (w can play A5 to make it a direct ko). That's a little confusing to me. By the way, white just need to find a small ko threat to win the game. I would think it would be better than sitting there and doing nothing about the ko.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 127 posts ]  Go to page 1, 2, 3, 4, 5 ... 7  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group