It is currently Mon Nov 11, 2024 8:13 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 402 posts ]  Go to page Previous  1 ... 17, 18, 19, 20, 21  Next
Author Message
Offline
 Post subject: Re: Engine Tournament
Post #381 Posted: Sat Mar 25, 2023 3:35 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
New type KataGo weight file (b18c384nbt-uec.bin) is a bit stronger than the 2022 year winner of its "middleweight" category (kata1-b40c256-s12350780416-d3055274313 - b18c384nbt-uec 9 - 11) and markedly stronger than "heavyweight" one: kata1-b60c320-s6782286336-d3070935549 - b18c384nbt-uec 3 - 17 (details).

New rate of KataGo strongest in their "categories" weight files:
"bantamweight" <|= 2 ^ 23 B (< 12 MiB) - g170e-b10c128-s1141046784-d204142634.bin (6)
"featherweight" 2 ^ 24 B (12 - 24 MiB) - I haven't
"lightweight" 2 ^ 25 B (24 - 48 MiB) - g170e-b15c192-s1672170752-d466197061.bin (5)
"welterweight" 2 ^ 26 B (48 - 96 MiB) - g170e|kata1-b20c256x2-s5303129600-d1228401921.bin (4)
"middleweight" 2 ^ 27 B (96 - 192 MiB) - b18c384nbt-uec.bin (1)
"light heavyweight" 2 ^ 28 B (192 - 384 MiB) - g170-b30c320x2-s4824661760-d1229536699.bin (3)
"heavyweight" 2 ^ 29 B (384 - 768 MiB) - kata1-b60c320-s6782286336-d3070935549.bin (2)
"super heavyweight" >|= 2 ^ 30 B (> 768 MiB) - I haven't

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #382 Posted: Sat May 13, 2023 5:55 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
LeelaZero became a bit stronger: 57-41 in summary (details).

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #383 Posted: Sat Jul 01, 2023 12:28 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Pachi (DCNN) became a bit stronger, but still is weaker than Zen (details).

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #384 Posted: Sat Jul 29, 2023 7:11 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Pachi (--nodcnn) became a bit stronger than Ray (details).
So the rating of Go engines without using GPU is next:

Top level
1) KataGo
2) LeelaZero
3) SAI

High level
4) Leela
5) Rayon
6) Zenith
7) Pachi_DCNN
8) Hiratuka

Middle level
9) Pachi
10)Ray
11)MoGo

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #385 Posted: Sat Aug 12, 2023 12:06 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
KataGo v1.13.0 is stronger (17-11) than previous version (details).

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #386 Posted: Sat Sep 09, 2023 2:42 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
KataGo b18c384nbt-optimisticv13-s5971M.bin - b18c384nbt-uec.bin: 13 - 7 (details).
So the rate of KataGo "weight categories" is next:
"bantamweight" <|= 2 ^ 23 B (< 12 MiB) - g170e-b10c128-s1141046784-d204142634.bin (6)
"featherweight" 2 ^ 24 B (12 - 24 MiB) - I haven't
"lightweight" 2 ^ 25 B (24 - 48 MiB) - g170e-b15c192-s1672170752-d466197061.bin (5)
"welterweight" 2 ^ 26 B (48 - 96 MiB) - g170e|kata1-b20c256x2-s5303129600-d1228401921.bin (4)
"middleweight" 2 ^ 27 B (96 - 192 MiB) - b18c384nbt-optimisticv13-s5971M.bin (1)
"light heavyweight" 2 ^ 28 B (192 - 384 MiB) - g170-b30c320x2-s4824661760-d1229536699.bin (3)
"heavyweight" 2 ^ 29 B (384 - 768 MiB) - kata1-b60c320-s6782286336-d3070935549.bin (2)
"super heavyweight" >|= 2 ^ 30 B (> 768 MiB) - I haven't

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #387 Posted: Sat Oct 28, 2023 3:30 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Pachi doesn't become stronger (details).

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #388 Posted: Sat Feb 17, 2024 12:47 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
During last year KataGo weight files of "middleweight category" became stronger, but of "heavyweight" - not (details).
The rate of KataGo "weight categories" with their strongest weight files:
"bantamweight" <|= 2 ^ 23 B (< 12 MiB) - g170e-b10c128-s1141046784-d204142634.bin (6)
"featherweight" 2 ^ 24 B (12 - 24 MiB) - I haven't
"lightweight" 2 ^ 25 B (24 - 48 MiB) - g170e-b15c192-s1672170752-d466197061.bin (5)
"welterweight" 2 ^ 26 B (48 - 96 MiB) - g170e|kata1-b20c256x2-s5303129600-d1228401921.bin (4)
"middleweight" 2 ^ 27 B (96 - 192 MiB) - kata1-b18c384nbt-s8526915840-d3929217702.bin & kata1-b40c256-s12860905472-d3197353276.bin (1)
"light heavyweight" 2 ^ 28 B (192 - 384 MiB) - g170-b30c320x2-s4824661760-d1229536699.bin (3)
"heavyweight" 2 ^ 29 B (384 - 768 MiB) - kata1-b60c320-s6782286336-d3070935549.bin (2)
"super heavyweight" >|= 2 ^ 30 B (> 768 MiB) - I haven't

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #389 Posted: Sat Mar 02, 2024 2:49 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
KataGo became stronger: 18 - 12 in sparring of v.1.14.0 vs v.1.13.0 (details).

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #390 Posted: Sat Mar 02, 2024 2:56 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Ray didn't become stronger (details).

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #391 Posted: Sat Apr 20, 2024 7:57 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
KataGo v. 1.14.1 - 1.14.0: 25 - 21 (details).


Last edited by q30 on Sat May 04, 2024 2:38 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #392 Posted: Sat May 04, 2024 2:37 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
New KataGo weight files of "light heavyweight category" are weaker than only "middleweight" ones (details).

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #393 Posted: Sat May 04, 2024 6:02 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
The current rate of KataGo "weight categories":
"bantamweight" <|= 2 ^ 23 B (< 12 MiB) - g170e-b10c128-s1141046784-d204142634.bin (6)
"featherweight" 2 ^ 24 B (12 - 24 MiB) - I haven't
"lightweight" 2 ^ 25 B (24 - 48 MiB) - g170e-b15c192-s1672170752-d466197061.bin (5)
"welterweight" 2 ^ 26 B (48 - 96 MiB) - g170e|kata1-b20c256x2-s5303129600-d1228401921.bin (4)
"middleweight" 2 ^ 27 B (96 - 192 MiB) - kata1-b18c384nbt-s9131461376-d4087399203.bin (1)
"light heavyweight" 2 ^ 28 B (192 - 384 MiB) - b28c512nbt-s5668008960-d4210144556.bin (2)
"heavyweight" 2 ^ 29 B (384 - 768 MiB) - kata1-b60c320-s6782286336-d3070935549.bin (3)
"super heavyweight" >|= 2 ^ 30 B (> 768 MiB) - I haven't

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #394 Posted: Sat May 04, 2024 4:57 pm 
Lives in gote

Posts: 609
Location: Adelaide, South Australia
Liked others: 213
Was liked: 269
Rank: Australian 2 dan
GD Posts: 200
q30 wrote:
New KataGo weight files of "light heavyweight category" are weaker than only "middleweight" ones (details).

It looks like you're using very fast time limits. In slower games, the larger networks get more value from the extra time and will become relatively stronger. Compare the 1-minute and 5-minute rankings at https://lifein19x19.com/viewtopic.php?p=248817#p248817 and see how kata_20b overtakes kata_15b by a large margin given more time (and similar but less drastically for LZ188, 40 blocks versus LZ157, 15 blocks).

Heavyweights are slower but more powerful :-)

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #395 Posted: Sat May 04, 2024 6:10 pm 
Lives in sente

Posts: 1040
Liked others: 0
Was liked: 182
And with computers, not absolute time but time and hardware.

We really are going to have to come to some agreement about those. What will be considered a "standard machine" and what "standard time controls.

And what sort of time controls? Allowing X per move is simple but I believe we will eventually want AI that can be making "time management" decisions << situation not critical; try to conserve time vs critical, use some of the saved time >>

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #396 Posted: Sat May 18, 2024 2:31 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Ray v. 11.1.0 - the strongest v. (from 02.09.19): 7 - 13 (details).

_________________
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions for automated attachment in Russian) & sparring games of Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #397 Posted: Sat May 25, 2024 3:51 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Quote:
It looks like you're using very fast time limits. In slower games, the larger networks get more value from the extra time and will become relatively stronger. Compare the 1-minute and 5-minute rankings at https://lifein19x19.com/viewtopic.php?p=248817#p248817 and see how kata_20b overtakes kata_15b by a large margin given more time (and similar but less drastically for LZ188, 40 blocks versus LZ157, 15 blocks).

Heavyweights are slower but more powerful :-)

I'm testing with 2 minutes per move. You can find number of visits for different weights network files on this and this pages.

Of course You are right. But the goal is to test with equal time and resources to each engine/weight. If You can test, how many time per move for this amount of visits will spend modern PC with 8-core CPU + modern video card GPU cores number, I will only welcome the release of these results data here.
I think, that ~10 seconds per move is that a usual end user uses...

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #398 Posted: Sat May 25, 2024 3:59 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Quote:
And with computers, not absolute time but time and hardware.

We really are going to have to come to some agreement about those. What will be considered a "standard machine" and what "standard time controls.

And what sort of time controls? Allowing X per move is simple but I believe we will eventually want AI that can be making "time management" decisions << situation not critical; try to conserve time vs critical, use some of the saved time >>

Of course You are right too. What I think about "standard" for usual end user (that prefers the computer to spend time thinking evenly), I had wrote in message above...

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #399 Posted: Fri Aug 09, 2024 11:37 pm 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
KataGo v.1.15.1-v.1.14.1: 10-14 (details).

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #400 Posted: Sat Aug 31, 2024 1:54 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
The KataGo "weight categories" new rate (details):
"bantamweight" <|= 2 ^ 23 B (< 12 MiB) - g170e-b10c128-s1141046784-d204142634.bin (6)
"featherweight" 2 ^ 24 B (12 - 24 MiB) - I haven't
"lightweight" 2 ^ 25 B (24 - 48 MiB) - g170e-b15c192-s1672170752-d466197061.bin (5)
"welterweight" 2 ^ 26 B (48 - 96 MiB) - g170e|kata1-b20c256x2-s5303129600-d1228401921.bin (4)
"middleweight" 2 ^ 27 B (96 - 192 MiB) - kata1-b18c384nbt-s9131461376-d4087399203.bin (2)
"light heavyweight" 2 ^ 28 B (192 - 384 MiB)- kata1-b28c512nbt-s7168446720-d4316919285.bin (1)
"heavyweight" 2 ^ 29 B (384 - 768 MiB)- kata1-b60c320-s6782286336-d3070935549.bin (3)
"super heavyweight" >|= 2 ^ 30 B (> 768 MiB)- I haven't

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 402 posts ]  Go to page Previous  1 ... 17, 18, 19, 20, 21  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group