It is currently Fri Apr 19, 2024 3:59 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 127 posts ]  Go to page Previous  1 ... 3, 4, 5, 6, 7  Next
Author Message
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #101 Posted: Tue Oct 15, 2019 4:10 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
@atn - see https://lifein19x19.com/viewtopic.php?p=249391#p249391 and/or the other posts in that thread about running KataGo first in a console so that you can see what's going on, and/or if the initial tuning process is successfully starting to run.

@wineandgolover - Cool, presumably you followed the instructions here? https://github.com/lightvector/KataGo#compiling
In those same instructions, you'll see some examples of how you can use the subcommands on the command line, including the arguments you need to pass to them (the neural net model file, configs, etc). The subcommand that runs a GTP engine is the one you will need to get Lizzie to use. Lizzie should have a place in its menus where you can specify a command line that it should use to run an engine. Mind you, Lizzie will probably run the command from Lizzie's directory, so you will need to either specify paths to the executable, model files and configs relative to Lizzie's directory, or copy all those things to Lizzie's directory.

See also the same thing I replied to atn above about as well - KataGo will need to do some tuning at the start, and Lizzie by default will confusingly hide all messages including possible error messages from you. You should also open up the config yourself in a text file and read the notes about performance at the top - feel free to experiment with the config settings to find the best performance on your computer. If you compiled from the tip of master on GitHub (rather than the latest official release, which was older), the commandline "benchmark" subcommand can also benchmark KataGo for you with different numbers of threads for a particular config.


This post by lightvector was liked by 3 people: Bill Spight, Gomoto, wineandgolover
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #102 Posted: Wed Oct 16, 2019 12:45 am 
Beginner

Posts: 4
Liked others: 1
Was liked: 1
Rank: EGF 9k
Thank you lightvector, Katago is definitely working fine.

I'll post an issue on lizzie's github.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #103 Posted: Wed Oct 16, 2019 12:54 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
lightvector, Will there be a new release this year?

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #104 Posted: Wed Oct 16, 2019 4:59 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
I hope so!

;-)

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #105 Posted: Thu Oct 17, 2019 1:03 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
big request - please remove the board size limit, or make the support option up to 52x52!

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #106 Posted: Thu Oct 17, 2019 7:59 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
Probably not. The problem is that the larger the board size limit, the more memory the program uses and the worse the performance, even if you don't actually play on the larger board, because some internal datastructures get initialized in order to be able to support those large boards (due to some tricky implementation details in the current implementation).

Also, the neural net is only trained on size 19 and smaller, so it will perform very poorly on such huge sizes, so there is really no point. One could try training on larger boards, but the larger the board the more expensive the training, and boards larger than 19 I don't see as actually that popular, so it doesn't seem worth the cost.

Although huge sizes are quite bad for the net, I think the current best net does okay on sizes in the low 20s despite training only on 19 and smaller. I haven't checked this in detail myself. But if that's the case, I could release a completely separate version supporting up to, say, 25x25. (separate, to avoid the cost for users who don't care about the large board).


This post by lightvector was liked by: And
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #107 Posted: Fri Oct 18, 2019 3:23 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
lightvector, Thank you!

KataGo plays very strong, I think it will play weaker on large boards, but still very good.
I can take up testing, buy a 1050ti graphics card. can release a "test" version at least up to 37x37?
but if will be a version 25x25, also great!
about the popularity of large boards - why rarely fly to the moon? not popular or no starship? maybe if will a good program for big boards, will play more? at kgs 37x37 tournaments are sometimes held: https://www.gokgs.com/tournInfo.jsp?id=739

the game on the big boards becomes completely different, so it is so interesting! about the game 37x37:
https://senseis.xmp.net/?LargeBoards

Leela 0.6.2 (2016-06-04) (37x37)
https://sjeng.org/leela.html

mygofriend Adjustable Board Size from 2x2 to 52x52
http://mygofriend.com/home

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #108 Posted: Mon Oct 28, 2019 12:42 pm 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
The new version of q5Go-1.0 https://github.com/bernds/q5Go/releases/tag/q5go-1.0
https://lifein19x19.com/viewtopic.php?p=240327#p240327
KataGo works on rectangular boards, for example 13x19, 4x19!

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #109 Posted: Fri Dec 06, 2019 4:48 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
new KataGo networks, even stronger https://github.com/lightvector/KataGo/i ... -533617837
2 games KataGo 10x128-s1108 - KataGo 10x128-s4073 (gt 610, 5 sec/move). in the first, the new network lost (b), in the second won (w):


Attachments:
KataGo 10x128-s1108-KataGo 10x128-s4073.sgf [1.84 KiB]
Downloaded 910 times
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #110 Posted: Sun Dec 08, 2019 12:44 am 
Lives with ko

Posts: 237
Location: Pasadena, USA
Liked others: 79
Was liked: 12
Rank: OGS 9 kyu
OGS: Maharani
I'm sorry if this has been asked before.

If komi is set to 7, does KataGo understand draws? If not, would it be possible to train KataGo to understand draws in the future?

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #111 Posted: Sun Dec 08, 2019 8:16 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
50 games KataGo 10x128-s1108 - KataGo 10x128-s4073 (gt 610, 5 sec/move), new network won 42:8 (21 b and 21 w)
in one game, the old network surrendered on move 150:


Attachments:
KataGo 10x128-s1108-KataGo 10x128-s4073.sgf [1.32 KiB]
Downloaded 880 times

This post by And was liked by: ez4u
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #112 Posted: Mon Dec 09, 2019 7:00 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
50 games KataGo 15x192-s2973 - KataGo 10x128-s4073 (gt 610, 5 sec/move), new network won 32:18 (15 b and 17 w)
look how gracefully the new network won in this game (15x192 surrendered on 101 moves):


Attachments:
KataGo 15x192-s2973-KataGo 10x128-s4073.sgf [1.02 KiB]
Downloaded 817 times
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #113 Posted: Fri Dec 20, 2019 3:54 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
new network 10x128 https://github.com/lightvector/KataGo/f ... del.txt.gz
https://github.com/lightvector/KataGo/i ... -567718559

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #114 Posted: Sun Dec 29, 2019 7:47 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
50 games 5 sec/move:
KataGo 10x128-s4588 - ELF v2 (gt 610) 37:13 (KataGo b 16:9 and KataGo w 21:4)
8 games the ELF lost due to the ladder.
without these games
KataGo - ELF 29:13 (KataGo b 13:9 and KataGo w 16:4)
two games, won KataGo:




Attachments:
ELF v2 - KataGo 10x128-s4588.sgf [1.96 KiB]
Downloaded 659 times
KataGo 10x128-s4588 - ELF v2.sgf [2.48 KiB]
Downloaded 669 times
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #115 Posted: Mon Dec 30, 2019 4:32 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
For higher playouts (visits), Katago is still much weaker than ELFv2.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #116 Posted: Tue Dec 31, 2019 1:16 am 
Lives with ko

Posts: 237
Location: Pasadena, USA
Liked others: 79
Was liked: 12
Rank: OGS 9 kyu
OGS: Maharani
splee99 wrote:
For higher playouts (visits), Katago is still much weaker than ELFv2.


What amount of playouts are we talking?

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #117 Posted: Tue Dec 31, 2019 9:15 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 180
And what real time associated with each? Discussing strength in terms of number of playouts if ignoring how much TIME involved for a given amount of hardware does not give a true picture, because go is played with finite time.

Thus telling us that network A is weaker than network B at X playouts each does not mean that network A is weaker than network B on machine Y at time control Z if when running on machine Y network A can do X playouts within Z seconds and network B cannot.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #118 Posted: Tue Dec 31, 2019 9:23 am 
Gosei
User avatar

Posts: 1349
Liked others: 202
Was liked: 203
with the same number of playouts, the elf network thinks about 7 times longer than 10x128.
if I play against a human, then I’m interested in how long he thinks, and it’s not at all interesting how much he weighs, what his pulse, temperature, etc. :)
or splee99 implies higher playouts, but with time parity?

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #119 Posted: Tue Dec 31, 2019 10:37 am 
Lives with ko

Posts: 237
Location: Pasadena, USA
Liked others: 79
Was liked: 12
Rank: OGS 9 kyu
OGS: Maharani
Even if we're just talking pure number of playouts (which I do find interesting)... At what point does ELF OpenGo v2 start giving much better results than KataGo?

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #120 Posted: Tue Dec 31, 2019 11:22 am 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
I was running a match between Katago(B) and ELF(W). Yes I used time parity with 20 seconds per move. The playouts are variable, but ELF used roughly 5000 playouts per move. It looks like ELF was ahead from the beginning to the end. I didn't set any resign threshold but at the end both sides indicated that Katago was lost.


Attachment:
kata-elf.sgf [2.88 KiB]
Downloaded 868 times

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 127 posts ]  Go to page Previous  1 ... 3, 4, 5, 6, 7  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group