It is currently Sun Jan 29, 2023 7:57 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 344 posts ]  Go to page Previous  1 ... 12, 13, 14, 15, 16, 17, 18  Next
Author Message
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #281 Posted: Fri Nov 25, 2022 4:02 pm 
Dies in gote

Posts: 20
Liked others: 0
Was liked: 3
Rank: KGS3dan
If anyone has a CUDA version of KataGo for the new architecture, could you please upload it?
I tried to compile using cmake before, but it didn't work in my environment.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #282 Posted: Fri Nov 25, 2022 4:16 pm 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
and the version of eigenavx2 for Windows please! :)


This post by And was liked by: Dragon
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #283 Posted: Fri Nov 25, 2022 10:24 pm 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
KataGo 18b, playouts 10 - 60b, playouts 10



Attachments:
18b - 60b.sgf [1.13 KiB]
Downloaded 565 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #284 Posted: Sat Nov 26, 2022 4:43 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
PC_Screen wrote:
Katago Eigen, same process, drop it inside the katago 1.11 eigen folder and replace the old katago.exe.

https://drive.google.com/file/d/18XJHc8 ... sp=sharing

As for the speed being lower, try running the benchmark in the command prompt (./katago.exe benchmark -model <NEURALNET>.bin.gz) and adjust the number of search threads based on it


many thanks! it works, with different networks, and 18b works. but the speed compared to eigen, eigenavx2 1.11.0 is tens times slower. something's wrong. :sad:

visits: 1
10b eigen 1.11 Time taken: 0.281
10b your file Time taken: 15.21

60b eigen 1.11 Time taken: 2.605
60b your file Time taken: 160.166

18b your file Time taken: 56.941


Last edited by And on Sun Nov 27, 2022 10:40 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #285 Posted: Sat Nov 26, 2022 10:05 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
second game KataGo 18b, playouts 10 - 60b, playouts 10
(60b-s665)



Attachments:
18b - 60b.sgf [1.1 KiB]
Downloaded 540 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #286 Posted: Sat Nov 26, 2022 8:13 pm 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
KataGo 18b, playouts 100 - CS Zero 9d H4



Attachments:
KataGo - CS Zero.sgf [1.7 KiB]
Downloaded 536 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #287 Posted: Sun Nov 27, 2022 8:16 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
KataGo 18b, playouts 100 - CS Zero 9d H5
after 347 moves CS Zero: winrate 64.3, B+32



Attachments:
KataGo - CS Zero.sgf [2.32 KiB]
Downloaded 527 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #288 Posted: Sun Nov 27, 2022 6:23 pm 
Beginner

Posts: 13
Liked others: 0
Was liked: 8
New KataGo 18b out, supposed to as strong as 60b at equal visits while also being faster than 40b, which means it should be stronger than both in an actual game.

https://cdn.discordapp.com/attachments/ ... 21b.bin.gz

Also test game: KataGo 1.11 18b (W) vs KataGo 1.3.5 40b (B) with 2H and 0.5 Komi, Japanese Rules. The time setting is 10s/move for both which gave them around 1-2k visits per move on average.



The new 18b KataGo managed a convincing win against a 2 year old KataGo despite the 2 handicap stones.


Attachments:
KataGo 135 40B vs Katago 111 18B - 2H - W + R.sgf [375.97 KiB]
Downloaded 511 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #289 Posted: Sun Nov 27, 2022 6:27 pm 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
"UEC finished this weekend...KataGo placed 2nd in the final (and first in the preliminaries)." https://discord.com/channels/4170221623 ... 4930181303

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #290 Posted: Mon Nov 28, 2022 12:47 pm 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
KataGo (18b-uec, playouts 1) - CS Zero 9d



Attachments:
KataGo - CS Zero.sgf [1016 Bytes]
Downloaded 504 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #291 Posted: Mon Nov 28, 2022 9:37 pm 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
100 games 19x19 KataGo 18b-uec (playouts 1) - 60b-s665 (playouts 1):
18b (B) - 60b (W) 21:29
18b (W) - 60b (B) 26:24

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #292 Posted: Tue Nov 29, 2022 12:05 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
100 games 19x19 KataGo 18b-uec (playouts 2) - 60b-s665 (playouts 1):
18b (B) - 60b (W) 32:18
18b (W) - 60b (B) 35:15

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #293 Posted: Tue Nov 29, 2022 6:32 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
10 games KataGo 18b-uec (playouts 10) - 60b-s665 (playouts 5):
18b (W) - 60b (B) 8:2



Attachments:
18b - 60b.sgf [1.5 KiB]
Downloaded 504 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #294 Posted: Tue Nov 29, 2022 10:52 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
10 games KataGo 18b-uec (playouts 10) - 60b-s665 (playouts 5):
18b (B) - 60b (W) 9:1



Attachments:
18b - 60b.sgf [1023 Bytes]
Downloaded 495 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #295 Posted: Tue Nov 29, 2022 11:28 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
in the position from here https://lifein19x19.com/viewtopic.php?p=244851#p244851, I turned on the analysis mode, the network 18b-uec. the move h1 was immediately highlighted. after ~200 visits, katago showed white winning, but then decided that there no winning and the winrate continued to fall :o
EDIT after 10K visits - 39.4

Click Here To Show Diagram Code
[go]$$Wc White to play
$$ ---------------------------------------
$$ | . . . . . . . . . . . . . . . . . . . |
$$ | . . . . . . O . . X . . . . . . . . . |
$$ | . X O O . . . X X O X X X . X X X . . |
$$ | . . X , O . O X O O . O . . . O X O . |
$$ | . X . X X X O O X O . . . . . . . . . |
$$ | . . O . . . O . X O . . X . . . O . . |
$$ | . . . . . O . . X . O O X . . O . . . |
$$ | . . X . . . O X X X O X X . X O . . . |
$$ | . . . . . . O O X O O X . O . X O . . |
$$ | . . . , . . O O O X X O . . . X O . . |
$$ | . . . . . . X O O X . O . . . X . . . |
$$ | . . O . . X . X X X O . . . . . X . . |
$$ | . . . . . X O . . X . . . . . . . . . |
$$ | . . . X . X O O O X . . . . . . . . . |
$$ | . . X O X X X O X O . O . . . . O . . |
$$ | . . O O O . X O X O . . . O . O . O . |
$$ | . . . O . O O X X O . . X X X X O X . |
$$ | . . . . . . X . . . . . . . . . X . . |
$$ | . . . . . . . . . . . . . . . . . . . |
$$ ---------------------------------------[/go]

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #296 Posted: Tue Nov 29, 2022 8:45 pm 
Beginner

Posts: 13
Liked others: 0
Was liked: 8
Result of a 100 games match between the latest 18b vs the strongest 40b (S1184), 1s/move (averaging 200-500 visits/move), Chinese Rules and komi is set to 7.0 which allows for draws. A draw is counted as +0.5 points for both players:
18b vs 40b:

65 : 35

From 18b's perspective:
Wins: 58
Draws: 14
Losses: 28

Elo Difference: +126.51 ± 73.59


Attachments:
KataGo 18B vs 40B S1184 Games 71 - 100.rar [1.4 MiB]
Downloaded 39 times
KataGo 18B vs 40B S1184 Games 36 - 70.rar [1.64 MiB]
Downloaded 36 times
KataGo 18B vs 40B S1184 Games 1 - 35.rar [1.86 MiB]
Downloaded 39 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #297 Posted: Wed Nov 30, 2022 5:00 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
10 games KataGo 18b-uec (playouts 20) - 60b-s665 (playouts 10):
18b (B) - 60b (W) 9:1



Attachments:
18b - 60b.sgf [1.51 KiB]
Downloaded 472 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #298 Posted: Fri Dec 02, 2022 10:21 am 
Lives in sente
User avatar

Posts: 1108
Liked others: 184
Was liked: 171
10 games KataGo 18b-uec (playouts 20) - 60b-s665 (playouts 10):
18b (W) - 60b (B) 10:0



Attachments:
18b - 60b.sgf [1.31 KiB]
Downloaded 440 times
Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #299 Posted: Sat Dec 03, 2022 9:25 am 
Beginner

Posts: 13
Liked others: 0
Was liked: 8
Thorough test done by @Medwin on the Go AI Discord, using 400 visits/move with a total of 2800 games played.

Attachment:
image.png
image.png [ 350.38 KiB | Viewed 1424 times ]


As expected, the new b18-uec is slightly stronger than 60b at equal visits (much stronger with equal time) and is expected to grow even stronger as its training run progresses. When KataGo 1.12 releases 18b is expected to replace 60b as the main network for training games.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo Distributed Training and new networks
Post #300 Posted: Tue Dec 06, 2022 2:26 pm 
Beginner

Posts: 13
Liked others: 0
Was liked: 8
Result of a 100 games match between the latest 18b vs the strongest 20b, 400 visits/move, Chinese Rules and komi is set to 7.0 which allows for draws. A draw is counted as +0.5 points for both players:
18b vs 20b:

92.5 : 7.5

From 18b's perspective:
Wins: 92
Draws: 1
Losses: 7

Elo Difference: +447.48 ± 132.32

Also did the same against Leela Zero, 1s/move, Tromp-Taylor Rules, 7.5 Komi, and the result was:

18b vs LZ 40B:

100:0

Elo can't be calculated from this since 18b didn't lose any games. Most estimates put Leela ~800 elo or so behind KataGo

Example Games:

18b vs 20b



18b vs LZ 40b:



Attachments:
100_black(Leela Zero)_vs_white(Katago 18B Test)_white(Katago 18B Test)Win_20221206181001.sgf [119.64 KiB]
Downloaded 350 times
100_black(KataGo 20B)_vs_white(Katago 18B Test)_white(Katago 18B Test)Win_20221205225742.sgf [167.26 KiB]
Downloaded 349 times
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 344 posts ]  Go to page Previous  1 ... 12, 13, 14, 15, 16, 17, 18  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group