It is currently Sun Feb 28, 2021 6:57 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 97 posts ]  Go to page Previous  1, 2, 3, 4, 5  Next
Author Message
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #21 Posted: Thu Jan 21, 2021 1:11 pm 
Lives with ko

Posts: 138
Liked others: 180
Was liked: 28
Rank: 25 kyu
I hope s572 or s570 is the net that gets optimized. It's strong enough now that no/few users will have to play against more than one playout. Great for a mobile app!

Just like against cs zero 9d, It also beat the strongest 7d rank on zen 6 (gui version, I have not tried gtp4zen). Using 1 playout, playing as white with no komi, zen resigned after 200 moves; s572 was leading by >70. zen 6 is a strong program that many dan players love to play against.
http://go.ba.net/playgo/go.html?sgf=3mDscV5Cq.sgf
https://ibb.co/GFTLG7j

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #22 Posted: Sat Jan 23, 2021 5:11 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
KataGo s572 playouts 1 - Zenith 7 9d:


Attachments:
KataGo - Zenith 7.sgf [1.59 KiB]
Downloaded 358 times

This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #23 Posted: Sat Jan 23, 2021 5:39 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
with the same time settings, CS Zero plays stronger
CS Zero 10 sec - Zenith 7 10 sec 14:6
CS Zero 60 sec - Zenith 7 60 sec 12:8
but when playing 9d it seemed to me that Zenith 7 is stronger. KataGo s572 playouts 1 without Komi could not win against Zenith 7


This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #24 Posted: Sat Jan 23, 2021 8:33 am 
Lives with ko

Posts: 138
Liked others: 180
Was liked: 28
Rank: 25 kyu
thanks for this, i was curious about it!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #25 Posted: Sat Jan 23, 2021 9:04 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
KataGo s572 playouts 1 - LZ #286 playouts 5, LZ surrenders on move 171

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #26 Posted: Sat Jan 23, 2021 2:55 pm 
Lives in gote

Posts: 643
Liked others: 105
Was liked: 768
Rank: maybe 2d
New distributed training run should be now open for anyone to connect!

https://lifein19x19.com/viewtopic.php?f=9&t=18019
https://www.reddit.com/r/baduk/comments ... ributions/


This post by lightvector was liked by 3 people: And, Friday9i, go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #27 Posted: Sat Jan 23, 2021 9:26 pm 
Lives in sente
User avatar

Posts: 850
Liked others: 309
Was liked: 343
Hi lightvector,

Are any of your contributors using Mac? I’m happy to help, but I'm probably a bad choice for a pioneer. My GPU's aren’t bad though.

_________________
- Brady
Want to see videos of low-dan mistakes and what to learn from them? Brady's Blunders

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #28 Posted: Sun Jan 24, 2021 5:53 am 
Dies in gote

Posts: 52
Liked others: 0
Was liked: 5
Rank: KGS 2 dan
KGS: hakuseki
This is just an idle thought, but would it make sense to increase the number of visits in self-play games in the later stages of a training run (i.e. now)?

My thought is that reinforcement learning will converge to a plateau where the approximation loss (e.g. the trained policy is 400 elo points weaker than the player it is approximating) equals the gain from tree search (e.g. 600 visits is 400 elo points stronger than 1 visit).

To move past the plateau it's necessary to either improve the approximator (e.g. by increasing network size) or approximate a stronger player (e.g. by increasing visits in search). I know KataGo already uses the former, but what about the latter?

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #29 Posted: Sun Jan 24, 2021 9:06 am 
Lives in gote

Posts: 643
Liked others: 105
Was liked: 768
Rank: maybe 2d
wineandgolover wrote:
Hi lightvector,

Are any of your contributors using Mac? I’m happy to help, but I'm probably a bad choice for a pioneer. My GPU's aren’t bad though.


Unfortunately I don't own a Mac, and don't have a great way to compile and test myself. I expect probably some people are using Mac for this, but if so, it's mainly going to be through building from source on their own. Which probably is not *too* hard, since (unlike Windows) I think package management and installation of libraries on Mac is pretty easy, similar to Linux? Things are a bit wordy here: https://github.com/lightvector/KataGo/b ... mpiling.md but the actual process is not hard (except on Windows).

Right now the release process is also a bit time-consuming for me, to compile everything on my own personal computers (windows and linux) and package stuff up. If someone were willing to put in the effort to help set up a more automated build process for releases, which could maybe include Mac as well, that would be fantastic.


This post by lightvector was liked by 2 people: ez4u, wineandgolover
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #30 Posted: Mon Jan 25, 2021 3:32 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
KataGo s581 playouts 1, komi 0 - Zenith 7 9d:


Attachments:
KataGo - Zenith 7.sgf [1.4 KiB]
Downloaded 235 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #31 Posted: Mon Jan 25, 2021 3:41 am 
Lives with ko

Posts: 135
Liked others: 40
Was liked: 21
Rank: KGS 6 dan
How to beat Zen without even thinking.


This post by johnsmith was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #32 Posted: Mon Jan 25, 2021 3:56 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
but in reality it was not easy - after 157 moves Zen winrate showed 83, and KataGo (if it is a winrate) W -85.92c
therefore this victory is more expensive!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #33 Posted: Thu Jan 28, 2021 5:10 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
KataGo s585 playouts 1 - Zen 9d H2 1:3


Attachments:
KataGo - Zen.sgf [1.87 KiB]
Downloaded 186 times

This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #34 Posted: Thu Jan 28, 2021 9:32 am 
Lives with ko

Posts: 138
Liked others: 180
Was liked: 28
Rank: 25 kyu
And, sorry probably stupid question but do you think s585 would beat zen 9 dan >50% in even games? Thanks for the games!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #35 Posted: Thu Jan 28, 2021 9:35 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
interesting! I'll play the match for the night!
I find it difficult to answer, since victories with a sufficient share of "luck" :)


This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #36 Posted: Thu Jan 28, 2021 10:32 am 
Lives with ko

Posts: 138
Liked others: 180
Was liked: 28
Rank: 25 kyu
Thanks And!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #37 Posted: Fri Jan 29, 2021 1:22 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
KataGo s585 playouts 1 - Zen 9d, komi 7.5, 14:6, KG W 7:3, B 7:3. 70%!


This post by And was liked by: go4thewin
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #38 Posted: Fri Jan 29, 2021 7:12 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
will the network be strong enough to win against 9 dan with a 9 stone handicap with 1 playouts? it seems incredible!

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #39 Posted: Fri Jan 29, 2021 8:56 am 
Lives with ko

Posts: 138
Liked others: 180
Was liked: 28
Rank: 25 kyu
I couldn't even believe your results. When I first saw it, I thought you must have set maxPlayouts to 1 but forgot to limit the numSearchthreads to 1 so it ran extra playouts, but when I ran two game I got the same result, 2:0, wow. The next bot to defeat is golaxy's elephant bot on 19x19.com, which they rate as "1p". I thought the katago policy would never defeat it or zen 7, but now I think soon it will defeat the elephant. This is amazing. Thanks And!


Attachments:
s5851poVSgtp4zen9d.sgf [1.4 KiB]
Downloaded 19 times
gtp4zen9dVSs5851po.sgf [1.15 KiB]
Downloaded 20 times

This post by go4thewin was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #40 Posted: Fri Jan 29, 2021 10:35 am 
Lives in gote
User avatar

Posts: 670
Liked others: 139
Was liked: 124
It seemed to me that the LZ is performing more than the set playouts, if you do not limit numSearchThreads. in KataGo, I did not limit this parameter, and the log file shows that only 1 playouts are being executed (always)


This post by And was liked by: go4thewin
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 97 posts ]  Go to page Previous  1, 2, 3, 4, 5  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group