A new run of KataGo released - strength comparable to ELFv2
-
birdinhand
- Beginner
- Posts: 3
- Joined: Tue Apr 16, 2019 5:11 am
- Rank: EGF 1 kyu
- GD Posts: 0
- Been thanked: 3 times
Re: A new run of KataGo released - strength comparable to EL
Just want to say a big thanks lightvector for getting opencl support in katago.
I was previously using leelazero run on a laptop (igpu) and it was OK to play with, using early 6 block networks (around 1dan strength).
Katago (6block) seems to play the endgame a bit better which is great.
leelazero (6block) would sometimes play the endgame a bit slack if the game was close, and then self implode.
like leelazero couldn't judge the score good enough in a close (+/-5 point) endgame.
I like the style of play too, it really likes to fight and complicate the game, often leaving groups unsettled.
leelazero 6 block likes to fight too, but katago 6 block even more so.
The adjustable komi is great too, so I can play 0.5 (or -6.5) komi games with the 6 block networks.
Something I liked about leelazero was that pangafu trained a 10 block leelazero master version using 80-90% human (pro?) games.
I wonder if something like that would be possible with katago 6 or 10 blocks?
I guess one of the holy grails of go AI is to be able to select different playing styles, such as takemiya sensei, cho chikun, go seigen, etc.
having parameters for how much to favour: influence, fighting, honte, etc...
good luck with the future research!
I was previously using leelazero run on a laptop (igpu) and it was OK to play with, using early 6 block networks (around 1dan strength).
Katago (6block) seems to play the endgame a bit better which is great.
leelazero (6block) would sometimes play the endgame a bit slack if the game was close, and then self implode.
like leelazero couldn't judge the score good enough in a close (+/-5 point) endgame.
I like the style of play too, it really likes to fight and complicate the game, often leaving groups unsettled.
leelazero 6 block likes to fight too, but katago 6 block even more so.
The adjustable komi is great too, so I can play 0.5 (or -6.5) komi games with the 6 block networks.
Something I liked about leelazero was that pangafu trained a 10 block leelazero master version using 80-90% human (pro?) games.
I wonder if something like that would be possible with katago 6 or 10 blocks?
I guess one of the holy grails of go AI is to be able to select different playing styles, such as takemiya sensei, cho chikun, go seigen, etc.
having parameters for how much to favour: influence, fighting, honte, etc...
good luck with the future research!
-
lightvector
- Lives in sente
- Posts: 759
- Joined: Sat Jun 19, 2010 10:11 pm
- Rank: maybe 2d
- GD Posts: 0
- Has thanked: 114 times
- Been thanked: 916 times
Re: A new run of KataGo released - strength comparable to EL
@ez4u - Yep, Aram pretty much has all the right ideas. The search usually benefits greatly from knowing the results of earlier visits when spending later visits and being able to explore deeply, and threading gets in the way of that.
@birdinhand - Thanks! More opening variety is definitely something I want to look into in the future. Done right, it may help learning in self-play as well.
@And - Yes, KataGo plays on other sizes. All square sizes from 9x9 through 19x19 were part of training. So, try a 12x12 game if you like. On 9x9 it does not match up to specially trained 9x9 bots (which can reach near-optimal) but overall should be extremely strong on all sizes in that range.
@birdinhand - Thanks! More opening variety is definitely something I want to look into in the future. Done right, it may help learning in self-play as well.
@And - Yes, KataGo plays on other sizes. All square sizes from 9x9 through 19x19 were part of training. So, try a 12x12 game if you like. On 9x9 it does not match up to specially trained 9x9 bots (which can reach near-optimal) but overall should be extremely strong on all sizes in that range.
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: A new run of KataGo released - strength comparable to EL
@lightvector, thank! it’s very good that can play KataGo on different boards, from 2x2 to 19x19! and even on rectangular ones! (only sabaki does not support rectangular). perhaps this is the only program with such features! in the latest release, the size limit is 19x19 for objective reasons? sometimes it's interesting to play on larger boards. Can you make support up to 37x37 or 52x52?
-
iopq
- Dies with sente
- Posts: 113
- Joined: Wed Feb 27, 2019 11:19 am
- Rank: 1d
- GD Posts: 0
- Universal go server handle: iopq
- Has thanked: 11 times
- Been thanked: 27 times
Re: A new run of KataGo released - strength comparable to EL
This isn't true, it has 40%+ winrate vs. specially trained 9x9 bots that have bigger networks (so likely equal strength at time parity) and I've spent many days trying to train one that beats it. Even the strongest networks are nowhere near optimal without several million playouts, and even then, sometimes can't read out the result if it depends on a ko fight at the end. Which most 9x9 games end up in anyway, since the engines can avoid a clear loss quite easily.lightvector wrote:On 9x9 it does not match up to specially trained 9x9 bots (which can reach near-optimal) but overall should be extremely strong on all sizes in that range.
In other words, at time parity there's no clear better bot on 9x9
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: A new run of KataGo released - strength comparable to EL
iopq, Is it possible that there is a bot that you have not tried, and it plays better?
or other results may be with other settings (visits or others)?
I wonder if you used opencl or cuda, and what settings, what videocard?
or other results may be with other settings (visits or others)?
I wonder if you used opencl or cuda, and what settings, what videocard?
-
iopq
- Dies with sente
- Posts: 113
- Joined: Wed Feb 27, 2019 11:19 am
- Rank: 1d
- GD Posts: 0
- Universal go server handle: iopq
- Has thanked: 11 times
- Been thanked: 27 times
Re: A new run of KataGo released - strength comparable to EL
The creator of the bot said he gave up on it, and is currently making a 9x9 KataGo run himself. His current bot is 15b and can beat KataGo on equal visits ~40% of the time, so I assume it's stronger on time parity.And wrote:iopq, Is it possible that there is a bot that you have not tried, and it plays better?
or other results may be with other settings (visits or others)?
I wonder if you used opencl or cuda, and what settings, what videocard?
His bot is the 171st network of his run, 30 blocks. I only tested the 168th or something like that. Similar strength to KataGo (stronger, but slower) but I didn't do a long test.
-
cyndane
- Dies in gote
- Posts: 65
- Joined: Mon Jan 14, 2013 12:02 pm
- Rank: 1k KGS
- GD Posts: 0
- Has thanked: 10 times
- Been thanked: 16 times
Re: A new run of KataGo released - strength comparable to EL
update your config and change the engine to something like this:
"engine-command": "./KataGo/main.exe gtp -model ./KataGo/model.txt -config ./KataGo/configs/gtp_example.cfg -override-version 0.17",
"engine-command": "./KataGo/main.exe gtp -model ./KataGo/model.txt -config ./KataGo/configs/gtp_example.cfg -override-version 0.17",
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: A new run of KataGo released - strength comparable to EL
cyndane, thanks for the answer! It works for me: "engine-command": "./katago gtp -model model.txt -config gtp_example.cfg",.
and need to change "network-file": "model.txt",.
what gives "-override-version 0.17"?
Rectangular board support has been merged into Lizzie https://github.com/leela-zero/leela-zer ... -513329967
this can be done?
and need to change "network-file": "model.txt",.
what gives "-override-version 0.17"?
Rectangular board support has been merged into Lizzie https://github.com/leela-zero/leela-zer ... -513329967
this can be done?
-
Tryss
- Lives in gote
- Posts: 502
- Joined: Tue May 24, 2011 1:07 pm
- Rank: KGS 2k
- GD Posts: 100
- KGS: Tryss
- Has thanked: 1 time
- Been thanked: 153 times
Re: A new run of KataGo released - strength comparable to EL
You need to "compile" yourself the latest version of lizzie to get the latest features.
Lizzie is constantly improving, but they don't make a new public release of compiled version for each new addition (actually, the latest release was the 0.6 november last year, and since then there was 190 commits (= change) to the code).
Lizzie is constantly improving, but they don't make a new public release of compiled version for each new addition (actually, the latest release was the 0.6 november last year, and since then there was 190 commits (= change) to the code).
-
lightvector
- Lives in sente
- Posts: 759
- Joined: Sat Jun 19, 2010 10:11 pm
- Rank: maybe 2d
- GD Posts: 0
- Has thanked: 114 times
- Been thanked: 916 times
Re: A new run of KataGo released - strength comparable to EL
And, your question seems already directly answered by Tryss's previous post:
If you don't want to do that, I guess you're probably limited to either asking nicely in the Lizzie Github for someone else to do it for you, or to wait for whenever they do make a new official release.Tryss wrote:You need to "compile" yourself the latest version of Lizzie to get the latest features.
-
And
- Gosei
- Posts: 1464
- Joined: Tue Sep 25, 2018 10:28 am
- GD Posts: 0
- Has thanked: 212 times
- Been thanked: 215 times
Re: A new run of KataGo released - strength comparable to EL
lightvector, thanks, I was counting on the fact that someone had already compiled it and posted it on a file hosting service.
how to run analysis mode in KataGo?
how to run analysis mode in KataGo?
-
iopq
- Dies with sente
- Posts: 113
- Joined: Wed Feb 27, 2019 11:19 am
- Rank: 1d
- GD Posts: 0
- Universal go server handle: iopq
- Has thanked: 11 times
- Been thanked: 27 times
Re: A new run of KataGo released - strength comparable to EL
Put the new lizzie.jar into your Lizzie folder
this version has better KataGo support
https://mega.nz/#!5d4THYBY!f0ReTYpjtswi ... KF62SuOTb8
this version has better KataGo support
https://mega.nz/#!5d4THYBY!f0ReTYpjtswi ... KF62SuOTb8