It is currently Thu Oct 31, 2024 4:24 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 127 posts ]  Go to page Previous  1, 2, 3, 4, 5 ... 7  Next
Author Message
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #21 Posted: Tue Jul 02, 2019 3:47 am 
Lives in gote

Posts: 445
Liked others: 0
Was liked: 37
These bots are close in strength but their weaknesses differ. Katago enjoys ladder vision and is therefore superior in positions with any ladder potential. This means in other positions like this one it is significantly weaker (as they match ~50%).

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #22 Posted: Wed Jul 03, 2019 8:00 am 
Tengen

Posts: 4382
Location: Caldas da Rainha, Portugal
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Does that follow? It seems to me that it means there must be more weaknesses overall in positions not featuring ladders, but it's still plausible that it will judge some positions better and some worse than LZ.

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #23 Posted: Wed Jul 03, 2019 8:36 am 
Lives in gote

Posts: 445
Liked others: 0
Was liked: 37
Sure, just like a kyu may judge a position better than a dan sometimes. But generally we can expect it to be significantly worse since the ladder gain also seems quite significant winrate-wise.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #24 Posted: Wed Jul 03, 2019 10:18 am 
Dies in gote

Posts: 65
Liked others: 10
Was liked: 16
Rank: 1k KGS
I dont think that follows at all. You are making many implicit assumptions about the frequency and severity of misjudged ladders.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #25 Posted: Wed Jul 03, 2019 10:31 am 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Never mind. :ugeek:

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.


Last edited by Bill Spight on Sat Nov 16, 2019 8:04 pm, edited 4 times in total.
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #26 Posted: Wed Jul 03, 2019 12:05 pm 
Lives in gote

Posts: 445
Liked others: 0
Was liked: 37
cyndane wrote:
You are making many implicit assumptions about the frequency and severity of misjudged ladders.
There were factual reports on this. And a few percent of actual losses on misplayed ladders suggest much more winrate loss because of search innefficiencies (misjudged HIDDEN ladders).

Bill: Are you sure B threat (g17) makes no difference?

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #27 Posted: Wed Jul 03, 2019 2:11 pm 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
jann wrote:
Bill: Are you sure B threat (g17) makes no difference?


I thought so, but after you asked, I changed my mind. But now I think I see White's reply after Black completes the threat, so that White wins by a few points. There is still a lot of play afterwards, and I don't want to post something erroneous. So I am checking the play.

OTOH, there is no question at all if White plays the ko at move 240. :)

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #28 Posted: Tue Jul 16, 2019 5:31 am 
Gosei
User avatar

Posts: 1425
Liked others: 205
Was liked: 204
katago v1.2-alpha https://github.com/leela-zero/leela-zero/issues/2448. Has anyone figured out how to run katago on windows?

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #29 Posted: Tue Jul 16, 2019 7:18 am 
Dies in gote

Posts: 53
Liked others: 2
Was liked: 12
Have a look at https://github.com/lightvector/KataGo/issues/2 for a windows version

If you can manage to compile Lizzie by yourself, you can make it work with that. There has already been made changes that supports KataGo, but they are not yet officially released

Also, you need an NVIDIA GPU with CUDA support

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #30 Posted: Tue Jul 16, 2019 7:37 am 
Gosei
User avatar

Posts: 1425
Liked others: 205
Was liked: 204
it seems there is a way easier and without problems with cuda

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #31 Posted: Wed Jul 17, 2019 4:48 am 
Dies in gote

Posts: 53
Liked others: 2
Was liked: 12
Ah seems you're right - appears there is a non-cuda version in your link.

You still need to build a newer version of Lizzie if you want more than just winrates and move suggestions though

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #32 Posted: Wed Jul 17, 2019 7:53 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
The most confusing part is to compile the cudahelpers.cu into an obj file. I made a batch file to run in command prompt with this contents:

NVCC cudahelpers.cu -c --cudart shared -gencode arch=compute_30,code=sm_30 -gencode arch=compute_30,code=compute_30 -gencode arch=compute_37,code=sm_37 -gencode arch=compute_53,code=sm_53 -gencode arch=compute_53,code=compute_53 -gencode arch=compute_70,code=sm_70 -gencode arch=compute_70,code=compute_70

Then you just need to put all the source code as defined in the cmakelist.txt into a project with the cudahelper.obj and compile in VS2017 IDE. Of course you also have to download any packages needed.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #33 Posted: Wed Jul 17, 2019 11:49 pm 
Lives in sente

Posts: 758
Liked others: 114
Was liked: 916
Rank: maybe 2d
Version 1.2-beta is now available with precompiled Windows OpenCL binaries
https://github.com/lightvector/KataGo/releases

OpenCL and Windows support are new, so there maybe be some further bumpiness in getting it working, so let me know if you run into problems or have questions. Happy to fix the inevitable bugs that arise.

For anyone in the boat of "compiling myself is way too scary"/"I don't have an nvidia GPU"/"The CUDA version didn't work for me", maybe this is all working now? I hope! :)

Enjoy!

@splee99 - not exactly sure what your compile set up looks like, but I didn't ever have to manually invoke nvcc compiling for CUDA, was there some issue you ran into, or maybe you were on a sufficiently much older version that something was fixed between then and now? I compiled the CUDA version attached in the release more-or-less by following the same instructions I posted to the latest readme at https://github.com/lightvector/KataGo#windows


This post by lightvector was liked by 3 people: And, dfan, Waylon
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #34 Posted: Thu Jul 18, 2019 7:06 am 
Gosei
User avatar

Posts: 1425
Liked others: 205
Was liked: 204
Parameters for sabaki, 1.2-beta opencl:

manage engines...
katago
d:\katago\katago.exe
gtp -model d:\katago\model.txt -config d:\katago\gtp_example.cfg

can set the time, for example time_settings 0 10 1

in the folder d:\katago place the network file for example from https://github.com/lightvector/KataGo/releases g104-b15c192-s297383936-d140330251.zip, unpack, use model.txt


This post by And was liked by: Waylon
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #35 Posted: Thu Jul 18, 2019 8:47 am 
Beginner

Posts: 19
Liked others: 0
Was liked: 2
This Shin Jinseo game illustrates a situation in which KataGo arrives at the correct positional evaluation very quickly compared to pure zero bots, such as LZ.

http://www.go4go.net/go/games/sgfview/84421

On Reddit (https://www.reddit.com/r/baduk/comments ... nt/eu0xgjz) uberdude shows that even with large numbers of playouts LZ has trouble. However, even at a couple thousand playouts KataGo is able to see that white has a crushing advantage.

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #36 Posted: Fri Jul 19, 2019 12:50 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
MiniGo and Elfv2 were much better at quickly evaluating the position correctly, so not all zero bots fail as badly as LZ here. I've not studied ladder problems much in recent networks, but a while ago I noticed a trend that (locally speaking irrespective of the truth of what's on the diagonal) Elfv1 tended to not see ladders or assume they didn't work, whilst 15b LZ tended to assume ladders do work. So in cases the ladder DOESN'T really work as here LZ will fail badly, and in cases the ladder DOES work Elf fails badly. I don't know about MiniGo.


This post by Uberdude was liked by 2 people: Bill Spight, lightvector
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #37 Posted: Sat Jul 20, 2019 9:05 am 
Beginner

Posts: 19
Liked others: 0
Was liked: 2
That's definitely pretty strange. I have noticed that on low playouts certain versions of LZ seemed to assume ladders work, but never realized there was a pattern. I've been really liking KataGo 1.1 for analysis, since I end up playing handicap games a lot on kgs.


This post by hoa803 was liked by: lightvector
Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #38 Posted: Sat Jul 20, 2019 12:28 pm 
Lives in gote

Posts: 445
Liked others: 0
Was liked: 37
It's more complex these days. In a recently discussed game LZ definitely looked the opposite corner where it had a few stones, got convinced the ladder doesn't work and pulled out. A nice step forward (except this ladder worked, but search couldn't see this since policy didn't suggest the - assumed to be broken - ladder moves).

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #39 Posted: Sun Jul 21, 2019 3:08 am 
Gosei
User avatar

Posts: 1425
Liked others: 205
Was liked: 204
How can I check performance, for example, visits or n/s? interesting to compare OpenCL and cuda

Top
 Profile  
 
Offline
 Post subject: Re: A new run of KataGo released - strength comparable to EL
Post #40 Posted: Sun Jul 21, 2019 1:54 pm 
Lives in sente

Posts: 758
Liked others: 114
Was liked: 916
Rank: maybe 2d
And wrote:
How can I check performance, for example, visits or n/s? interesting to compare OpenCL and cuda

Download them both, try them out on a variety of positions to adjust how many threads you should use for best performance for each one, and see how long searches with different numbers of visits takes?


This post by lightvector was liked by: And
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 127 posts ]  Go to page Previous  1, 2, 3, 4, 5 ... 7  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group