It is currently Thu Mar 28, 2024 1:56 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 418 posts ]  Go to page Previous  1 ... 17, 18, 19, 20, 21
Author Message
Offline
 Post subject: Re: LZ's progression
Post #401 Posted: Fri May 17, 2019 7:16 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
For higher playouts, for example 2500 vs 5000, ELF becomes weaker than 226. It's just my initial observation.

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #402 Posted: Sat May 18, 2019 4:34 am 
Beginner

Posts: 3
Liked others: 3
Was liked: 6
nbc44 wrote:
Сity legend check (l0XXX 1600 visits vs elfv2 3200 visits):

P.S. If someone wants the games, I can upload them.


I'd like to have these games, interesting to take a look at the next LZ vs ELF episode)

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #403 Posted: Fri May 24, 2019 4:04 am 
Lives in gote

Posts: 337
Liked others: 22
Was liked: 97
Interesting topic HERE about a new LZ network.

The provided network (14a3a) looked very promising...
I've tested it, using regular LZ017, first at H9 (komi 0.5) against gnugo (5 kyu)
it won 2 games out of 3 !
(laptop with gtx965, ~3 sec/move effectively used)

Sabaki settings for GnuGo:
Code:
--mode gtp  --level 10
Sabaki settings for for 14a3a
Code:
C:\...\leela-zero-0.17-win64\leelaz.exe   AND   --gtp -w C:...\14a3a5f70.gz --noponder -r 0  AND  time_settings 0 5 1    -komi 0.5

One of the H9 games : here




Second test : 50-game match between 14a3a and #226 (--noponder -v 1600)
14a3a won 52% (gogui 1.5.1, no error, no duplicate game, ~200 moves/game, ~170s/game for #226 or for 14a3a, all games by resignation)

the stats :
Attachment:
stat.gif
stat.gif [ 160.02 KiB | Viewed 9790 times ]
the games :
Attachment:
lz_226v14a3.zip [42.17 KiB]
Downloaded 442 times

So, a very interesting network, despite the poor "official" result against 226...


This post by Vargo was liked by: SHKD
Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #404 Posted: Fri May 24, 2019 7:44 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
Vargo wrote:
Second test : 50-game match between 14a3a and #226 (--noponder -v 1600)
14a3a won 52% (gogui 1.5.1, no error, no duplicate game, ~200 moves/game, ~170s/game for #226 or for 14a3a, all games by resignation)

the stats :
Attachment:
stat.gif
the games :
Attachment:
lz_226v14a3.zip

So, a very interesting network, despite the poor "official" result against 226...

the less games, the less reliable result. “Official” result obtained from 158 games.
99a8d3a3 - 226:174 and 115:132 in the official test. maybe even 400 games is not enough


Last edited by And on Fri May 24, 2019 8:22 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #405 Posted: Fri May 24, 2019 8:01 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
I wonder why you chose gnugo for handicap tests? the program is quite old. Now programs play differently. possible choose something newer with adjustable strength. By the way, have you tried gnugo with the --cache-size option? (e.g. 256mb)

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #406 Posted: Fri May 24, 2019 8:45 am 
Lives in gote

Posts: 337
Liked others: 22
Was liked: 97
And wrote:
the less games, the less reliable result. “Official” result obtained from 158 games.
Yes, but in the original post about this network, a lot more than 158 games have been played by 14a3a, and the results were 50+% vs 226

And wrote:
I wonder why you chose gnugo for handicap tests?
GnuGo is 5 kyu, it's a reference point.
Ideally, I'd choose Crazy Stone DL for handicap games, it can be set anywhere from 13 kyu to 7 Dan , but CSDL can't be used in Sabaki...

But you're right, these networks are so strong at handicap, that I have only two choices :
1) Forget GnuGo and find another reference point
2) Keep on using Gnugo and ask Sabaki's authors to add the possibility to play at H10, H11, etc. ;-)

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #407 Posted: Fri May 24, 2019 11:24 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
Vargo,
and if to use gtp4zen or cs dl directly through gtool2? (tool for auto-playing between two igo softs. but a lot of games will of course be tedious)

PS I checked gtp4zen 0.3.5 (zen7), gogui 1.5.1, H9, settings zen7: 5K -t1 -r5 -s800 -n1 -o2.4 -p0.3 (https://github.com/breakwa11/GoAIRating ... /AIcmds.md). gtp4zen playing white, then black - all ok

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #408 Posted: Sat May 25, 2019 7:15 am 
Lives in gote

Posts: 337
Liked others: 22
Was liked: 97
I tried LZ017_14a3a v gtp4zen(7) at H9

First, with --noponder -v 200 -r 1 for LZ
But... -r 1 makes it resign too soon, for example, in this position. I think a 5kyu can be invaded by W.
Attachment:
toosoon.jpg
toosoon.jpg [ 140.44 KiB | Viewed 9637 times ]



After that, I tried --noponder -v 200 -r 0 for LZ
with the hope that LZ wouldn't resign so soon.
These settings work when LZ_14a3a wins, for example in these games against gtp4zen.exe (-t4 -r5 -s800 -n1 -o2.4 -p0.3, corresponding to ~5 kyu)



or




But against (gtp4zen.exe -t4 -s1000 -n1 -o2.0 -p0.3) , corresponding to ~3k,
H9 is too much, and 14a3a loses heavily, but thinks it has won (the correct score is RES_B)

#GAME...RES_B....RES_W
0.......B+92.5...W+12.5
1.......B+102.5..W+3.5




Go figure :scratch: !


EDIT : The two posts with various handicaps contained 2 errors in gtp4zen parameters (3d and 5d parameters were wrong) , I removed them.


Attachments:
z7_5kv14ar0-0.sgf [1.86 KiB]
Downloaded 1710 times
z7_5kv14ar0-1.sgf [1.48 KiB]
Downloaded 1722 times
Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #409 Posted: Sun Jun 02, 2019 8:05 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
What will happen to the new network LZ? search to win? or will something change?

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #410 Posted: Mon Jun 03, 2019 3:04 pm 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
False promotion lz227? https://github.com/leela-zero/leela-zero/issues/2421

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #411 Posted: Tue Jun 11, 2019 9:05 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
Extensive tests of LZ improvements: true ELO gain is ~5 ELO per net since LZ174 https://github.com/leela-zero/leela-zero/issues/2425


This post by And was liked by: SHKD
Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #412 Posted: Tue Aug 06, 2019 10:55 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
new rules ? 923 games!? http://zero.sjeng.org
2019-08-06 16:14 88765231 VS a4f5d99a 390 : 318 (55.08%) 708 / 400 PASS
2019-08-06 16:14 88765231 VS a4f5d99a 498 : 425 (53.95%) 923 / 400 fail

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #413 Posted: Fri Aug 16, 2019 6:19 am 
Dies in gote

Posts: 44
Liked others: 2
Was liked: 14
Rank: EGF 1 kyu
KGS: finity
And wrote:
new rules ? 923 games!? http://zero.sjeng.org
2019-08-06 16:14 88765231 VS a4f5d99a 390 : 318 (55.08%) 708 / 400 PASS
2019-08-06 16:14 88765231 VS a4f5d99a 498 : 425 (53.95%) 923 / 400 fail


I recall that the gating test is a probability one, it might be that if you're very close to the treshold, it keeps playing until certain probability is reached.

Still, 900 games sounds like tossing a coin twenty time to get heads. Another plausible explanation is some server configuration/connectivity issue that gave out a lot of match games to clients but couldn't receive them, and once that was resolved, finally got them all (or most) back.

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #414 Posted: Fri Aug 16, 2019 9:26 am 
Dies in gote

Posts: 53
Liked others: 3
Was liked: 33
Rank: KGS 2k
Nothing to see here.. it was an error and it has been fixed in the server code so it would not happen again..

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #415 Posted: Wed Aug 21, 2019 12:09 pm 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
LZ#239 VS LZ#230 53.00% ???
2019-08-21 17:07 3bd93d6e VS a9543f21 212 : 188 (53.00%) 400 / 400 fail
http://zero.sjeng.org

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #416 Posted: Fri Aug 23, 2019 3:27 pm 
Dies with sente

Posts: 113
Liked others: 11
Was liked: 27
Rank: 1d
Universal go server handle: iopq
LZ240 still beat LZ230
0e17a181 VS a9543f21
225 : 176 (56.11%) 401 / 400 PASS

Then from discord jio tested

Quote:
lz_240 v lz_230 (400/400 games)
board size: 19 komi: 7.5
wins black white avg cpu
lz_240 233 58.25% 106 53.00% 127 63.50% 214.76
lz_230 167 41.75% 73 36.50% 94 47.00% 216.98
179 44.75% 221 55.25%

cmdline options: "-g -t 6 --batchsize 5 --noponder -v 1600 -r 5 --precision half"


this is in line with previous results, slower progress, but progress nevertheless

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #417 Posted: Sun Oct 06, 2019 2:21 am 
Dies in gote

Posts: 63
Liked others: 0
Was liked: 3
iopq wrote:
LZ240 still beat LZ230
0e17a181 VS a9543f21
225 : 176 (56.11%) 401 / 400 PASS

Then from discord jio tested

Quote:
lz_240 v lz_230 (400/400 games)
board size: 19 komi: 7.5
wins black white avg cpu
lz_240 233 58.25% 106 53.00% 127 63.50% 214.76
lz_230 167 41.75% 73 36.50% 94 47.00% 216.98
179 44.75% 221 55.25%

cmdline options: "-g -t 6 --batchsize 5 --noponder -v 1600 -r 5 --precision half"



average of 3 real elo per net?

this is in line with previous results, slower progress, but progress nevertheless

Top
 Profile  
 
Offline
 Post subject: Re: LZ's progression
Post #418 Posted: Fri Oct 11, 2019 7:46 pm 
Dies in gote

Posts: 50
Liked others: 0
Was liked: 3
LZv17 #219 vs LZ (MiniGo training data) (https://github.com/leela-zero/leela-zero/issues/2509)
2x1080ti, v 2400
C:\APPS\l0gpu17\validation.exe -k lz247-minigo17 -s "0:1" -g 5 -n C:\APPS\net\901e04de.gz -o "-g -v 2400 --gpu 0 --gpu 1 -r 5 -t 2 --batchsize 1 --noponder -q -d --timemanage off --precision single -w" -n C:\APPS\net\leelaz-model-swa-16-768000.gz -o "-g -v 2400 --gpu 0 --gpu 1 -r 5 -t 2 --batchsize 1 --noponder -q -d --timemanage off --precision single -w " -- C:\APPS\l0gpu17\leelaz -- C:\APPS\l0gpu17\leelaz

Code:
#247 v MG17 ( 400 games)
          wins        black       white
#247  178 44.50%   72 43.64%  106 45.11%
MG17  222 55.50%   93 56.36%  129 54.89%
                  165 41.25%  235 58.75%
400 games played.
Status: 0 LLR -0.128628 Lower Bound -2.94444 Upper Bound 2.94444

:clap:


Attachments:
lz247-minigo17.zip [368.65 KiB]
Downloaded 409 times
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 418 posts ]  Go to page Previous  1 ... 17, 18, 19, 20, 21

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Google [Bot] and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group