KataGo Distributed Training and new networks

For discussing go computing, software announcements, etc.
akigo
Lives with ko
Posts: 186
Joined: Sun Jun 28, 2020 11:20 am
GD Posts: 0
Has thanked: 13 times
Been thanked: 154 times

Re: KataGo Distributed Training and new networks

Post by akigo »

In my test matches I always use one search thread for the optimized network in BadukAI because:

1) Almost all calculations are done on the NPU which exists only once, so you don't gain significant speed with more threads, so why use them ?

2) Due to the above SW architecture, one thread may be blocked by the other for a lot of playouts, which can have very bad effects on the search process, so might lose significant strength.
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

BadukAI 40b optimized version 1.13.2 (maxPlayouts 15, numSearchThreads 2) - Sabaki 40b s1110 (maxPlayouts 10, numSearchThreads 2) 1:1


Attachments
s1110 - opt s1110.sgf
(1.61 KiB) Downloaded 959 times
opt s1110 - s1110.sgf
(1.22 KiB) Downloaded 964 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

akigo wrote:In my test matches I always use one search thread for the optimized network in BadukAI because:

1) Almost all calculations are done on the NPU which exists only once, so you don't gain significant speed with more threads, so why use them ?

2) Due to the above SW architecture, one thread may be blocked by the other for a lot of playouts, which can have very bad effects on the search process, so might lose significant strength.
thanks! this is very useful information!
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

1 and 2 game BadukAI 40b optimized version 1.13.2 (maxPlayouts 15, numSearchThreads 1) - Sabaki 40b s1110 (maxPlayouts 10, numSearchThreads 1) 1:1


Attachments
opt s1110 - s1110.sgf
(1.76 KiB) Downloaded 958 times
s1110 - opt s1110.sgf
(1.08 KiB) Downloaded 940 times
Last edited by And on Fri Feb 25, 2022 2:51 am, edited 1 time in total.
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

if interested, I will upload BadukAI log files
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

3 and 4 game BadukAI - Sabaki 1:1


Attachments
opt s1110 - s1110.sgf
(1.22 KiB) Downloaded 1153 times
s1110 - opt s1110.sgf
(906 Bytes) Downloaded 1156 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

5 and 6 game BadukAI - Sabaki 1:1


Attachments
opt s1110 - s1110.sgf
(732 Bytes) Downloaded 1135 times
s1110 - opt s1110.sgf
(1.2 KiB) Downloaded 1157 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

7 and 8 game BadukAI - Sabaki 1:1


Attachments
opt s1110 - s1110.sgf
(792 Bytes) Downloaded 1122 times
s1110 - opt s1110.sgf
(924 Bytes) Downloaded 1114 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

9 and 10 game BadukAI - Sabaki 0:2
after 10 games BadukAI (40b optimized version 1.13.2, maxPlayouts 15, numSearchThreads 1) - Sabaki (40b s1110 maxPlayouts 10, numSearchThreads 1) 4:6


Attachments
opt s1110 - s1110.sgf
(966 Bytes) Downloaded 1079 times
s1110 - opt s1110.sgf
(924 Bytes) Downloaded 1091 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

BadukAI (40b optimized version 1.13.2, maxPlayouts 12, numSearchThreads 1) - Sabaki (40b s1110 maxPlayouts 10, numSearchThreads 1)
1 and 2 game 1:1


Attachments
opt s1110 - s1110.sgf
(828 Bytes) Downloaded 1080 times
s1110 - opt s1110.sgf
(1.21 KiB) Downloaded 1087 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

3 and 4 game BadukAI - Sabaki 1:1


Attachments
opt s1110 - s1110.sgf
(986 Bytes) Downloaded 1064 times
s1110 - opt s1110.sgf
(1.56 KiB) Downloaded 1046 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

5 and 6 game BadukAI - Sabaki 1:1


Attachments
opt s1110 - s1110.sgf
(1014 Bytes) Downloaded 1047 times
s1110 - opt s1110.sgf
(618 Bytes) Downloaded 1059 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

7 and 8 game BadukAI - Sabaki 1:1


Attachments
opt s1110 - s1110.sgf
(906 Bytes) Downloaded 1057 times
s1110 - opt s1110.sgf
(810 Bytes) Downloaded 1038 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

9 and 10 game BadukAI - Sabaki 2:0
after 10 games BadukAI (40b optimized version 1.13.2, maxPlayouts 12, numSearchThreads 1) - Sabaki (40b s1110 maxPlayouts 10, numSearchThreads 1) 6:4


Attachments
opt s1110 - s1110.sgf
(1.37 KiB) Downloaded 1002 times
s1110 - opt s1110.sgf
(486 Bytes) Downloaded 1043 times
Amigo
Dies in gote
Posts: 54
Joined: Sat Sep 28, 2019 12:06 pm
GD Posts: 0
Has thanked: 60 times
Been thanked: 10 times

Re: KataGo Distributed Training and new networks

Post by Amigo »

I have never seen such a short game!
Post Reply