It is currently Thu Mar 28, 2024 1:52 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 440 posts ]  Go to page Previous  1, 2, 3, 4, 5 ... 22  Next
Author Message
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #21 Posted: Thu Jan 21, 2021 1:11 pm 
Lives with ko

Posts: 150
Liked others: 200
Was liked: 30
Rank: 25 kyu
I hope s572 or s570 is the net that gets optimized. It's strong enough now that no/few users will have to play against more than one playout. Great for a mobile app!

Just like against cs zero 9d, It also beat the strongest 7d rank on zen 6 (gui version, I have not tried gtp4zen). Using 1 playout, playing as white with no komi, zen resigned after 200 moves; s572 was leading by >70. zen 6 is a strong program that many dan players love to play against.
http://go.ba.net/playgo/go.html?sgf=3mDscV5Cq.sgf
https://ibb.co/GFTLG7j

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #22 Posted: Sat Jan 23, 2021 5:11 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
KataGo s572 playouts 1 - Zenith 7 9d:


Attachments:
KataGo - Zenith 7.sgf [1.59 KiB]
Downloaded 992 times

This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #23 Posted: Sat Jan 23, 2021 5:39 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
with the same time settings, CS Zero plays stronger
CS Zero 10 sec - Zenith 7 10 sec 14:6
CS Zero 60 sec - Zenith 7 60 sec 12:8
but when playing 9d it seemed to me that Zenith 7 is stronger. KataGo s572 playouts 1 without Komi could not win against Zenith 7


This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #24 Posted: Sat Jan 23, 2021 8:33 am 
Lives with ko

Posts: 150
Liked others: 200
Was liked: 30
Rank: 25 kyu
thanks for this, i was curious about it!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #25 Posted: Sat Jan 23, 2021 9:04 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
KataGo s572 playouts 1 - LZ #286 playouts 5, LZ surrenders on move 171

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #26 Posted: Sat Jan 23, 2021 2:55 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
New distributed training run should be now open for anyone to connect!

https://lifein19x19.com/viewtopic.php?f=9&t=18019
https://www.reddit.com/r/baduk/comments ... ributions/


This post by lightvector was liked by 3 people: And, Friday9i, go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #27 Posted: Sat Jan 23, 2021 9:26 pm 
Lives in sente
User avatar

Posts: 866
Liked others: 318
Was liked: 345
Hi lightvector,

Are any of your contributors using Mac? I’m happy to help, but I'm probably a bad choice for a pioneer. My GPU's aren’t bad though.

_________________
- Brady
Want to see videos of low-dan mistakes and what to learn from them? Brady's Blunders

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #28 Posted: Sun Jan 24, 2021 5:53 am 
Dies with sente

Posts: 100
Liked others: 0
Was liked: 15
Rank: KGS 2 dan
KGS: hakuseki
This is just an idle thought, but would it make sense to increase the number of visits in self-play games in the later stages of a training run (i.e. now)?

My thought is that reinforcement learning will converge to a plateau where the approximation loss (e.g. the trained policy is 400 elo points weaker than the player it is approximating) equals the gain from tree search (e.g. 600 visits is 400 elo points stronger than 1 visit).

To move past the plateau it's necessary to either improve the approximator (e.g. by increasing network size) or approximate a stronger player (e.g. by increasing visits in search). I know KataGo already uses the former, but what about the latter?

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #29 Posted: Sun Jan 24, 2021 9:06 am 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
wineandgolover wrote:
Hi lightvector,

Are any of your contributors using Mac? I’m happy to help, but I'm probably a bad choice for a pioneer. My GPU's aren’t bad though.


Unfortunately I don't own a Mac, and don't have a great way to compile and test myself. I expect probably some people are using Mac for this, but if so, it's mainly going to be through building from source on their own. Which probably is not *too* hard, since (unlike Windows) I think package management and installation of libraries on Mac is pretty easy, similar to Linux? Things are a bit wordy here: https://github.com/lightvector/KataGo/b ... mpiling.md but the actual process is not hard (except on Windows).

Right now the release process is also a bit time-consuming for me, to compile everything on my own personal computers (windows and linux) and package stuff up. If someone were willing to put in the effort to help set up a more automated build process for releases, which could maybe include Mac as well, that would be fantastic.


This post by lightvector was liked by 2 people: ez4u, wineandgolover
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #30 Posted: Mon Jan 25, 2021 3:32 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
KataGo s581 playouts 1, komi 0 - Zenith 7 9d:


Attachments:
KataGo - Zenith 7.sgf [1.4 KiB]
Downloaded 802 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #31 Posted: Mon Jan 25, 2021 3:41 am 
Lives with ko

Posts: 136
Liked others: 47
Was liked: 21
Rank: KGS 6 dan
How to beat Zen without even thinking.


This post by johnsmith was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #32 Posted: Mon Jan 25, 2021 3:56 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
but in reality it was not easy - after 157 moves Zen winrate showed 83, and KataGo (if it is a winrate) W -85.92c
therefore this victory is more expensive!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #33 Posted: Thu Jan 28, 2021 5:10 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
KataGo s585 playouts 1 - Zen 9d H2 1:3


Attachments:
KataGo - Zen.sgf [1.87 KiB]
Downloaded 745 times

This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #34 Posted: Thu Jan 28, 2021 9:32 am 
Lives with ko

Posts: 150
Liked others: 200
Was liked: 30
Rank: 25 kyu
And, sorry probably stupid question but do you think s585 would beat zen 9 dan >50% in even games? Thanks for the games!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #35 Posted: Thu Jan 28, 2021 9:35 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
interesting! I'll play the match for the night!
I find it difficult to answer, since victories with a sufficient share of "luck" :)


This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #36 Posted: Thu Jan 28, 2021 10:32 am 
Lives with ko

Posts: 150
Liked others: 200
Was liked: 30
Rank: 25 kyu
Thanks And!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #37 Posted: Fri Jan 29, 2021 1:22 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
KataGo s585 playouts 1 - Zen 9d, komi 7.5, 14:6, KG W 7:3, B 7:3. 70%!


This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #38 Posted: Fri Jan 29, 2021 7:12 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
will the network be strong enough to win against 9 dan with a 9 stone handicap with 1 playouts? it seems incredible!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #39 Posted: Fri Jan 29, 2021 8:56 am 
Lives with ko

Posts: 150
Liked others: 200
Was liked: 30
Rank: 25 kyu
I couldn't even believe your results. When I first saw it, I thought you must have set maxPlayouts to 1 but forgot to limit the numSearchthreads to 1 so it ran extra playouts, but when I ran two game I got the same result, 2:0, wow. The next bot to defeat is golaxy's elephant bot on 19x19.com, which they rate as "1p". I thought the katago policy would never defeat it or zen 7, but now I think soon it will defeat the elephant. This is amazing. Thanks And!


Attachments:
s5851poVSgtp4zen9d.sgf [1.4 KiB]
Downloaded 385 times
gtp4zen9dVSs5851po.sgf [1.15 KiB]
Downloaded 364 times

This post by go4thewin was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #40 Posted: Fri Jan 29, 2021 10:35 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
It seemed to me that the LZ is performing more than the set playouts, if you do not limit numSearchThreads. in KataGo, I did not limit this parameter, and the log file shows that only 1 playouts are being executed (always)


This post by And was liked by: go4thewin
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 440 posts ]  Go to page Previous  1, 2, 3, 4, 5 ... 22  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Bing [Bot] and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group