It is currently Tue Sep 25, 2018 6:18 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 16 posts ] 
Author Message
Offline
 Post subject: LeelaSabaki - Leela integration with Sabaki
Post #1 Posted: Sat Dec 09, 2017 1:50 pm 
Dies in gote
User avatar

Posts: 57
Location: Germany
Liked others: 0
Was liked: 14
Rank: 4 kyu
Several people have requested some type of Leela integration for Sabaki, but it's not Sabaki's philosophy to prefer one engine over another. So I've decided to draft some sort of engine integration protocol for Sabaki as a GTP extension, so that any engine can tell Sabaki what to do (in a limited way). It's still in the works, but I've implemented something in the Sabaki v0.32.0 beta version.

Together with the new Sabaki beta, I've also written LeelaSabaki, a laconically named proxy to Leela, which extends Leela with the aforementioned engine integration protocol. Currently, LeelaSabaki only does one thing: Whenever a move is generated, LeelaSabaki will add other variations Leela considered to the game tree in Sabaki, along with winning statistics. It also works with Leela Zero.

Attachment:
File comment: Leela integration with Sabaki
screenshot.png
screenshot.png [ 489.7 KiB | Viewed 5047 times ]

I don't want to say any more about the engine integration protocol, as I don't want other engines to implement it just yet, because it might change drastically soon. But I'd be happy if you give LeelaSabaki a try; just follow the instructions and make sure you're using Sabaki v0.32.0 beta. Furthermore, I'm interested in hearing how you think Leela (or any engine in general) can integrate itself more with Sabaki.


This post by yishn was liked by 2 people: apetresc, sorin
Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #2 Posted: Sat Dec 09, 2017 1:55 pm 
Lives in gote

Posts: 611
Location: Austin, Texas, USA
Liked others: 43
Was liked: 201
This is great, I'll have a look later. I wanted to mention I think I saw an issue with Sabaki and LeelaZero where if you click somewhere in the tree and ask LeelaZero to make a move, Sabaki does not replay the game to LeelaZero correctly. It replays all black moves and then all white moves. LeelaZero depends on the correct move order, so this confuses it. Can you look into this?

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #3 Posted: Sat Dec 09, 2017 2:10 pm 
Dies in gote
User avatar

Posts: 57
Location: Germany
Liked others: 0
Was liked: 14
Rank: 4 kyu
yoyoma wrote:
I wanted to mention I think I saw an issue with Sabaki and LeelaZero where if you click somewhere in the tree and ask LeelaZero to make a move, Sabaki does not replay the game to LeelaZero correctly. It replays all black moves and then all white moves.

I've explained this behavior here: https://github.com/yishn/Sabaki/pull/294

But I see why replaying with correct move order is important. I'm open to solutions.

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #4 Posted: Sat Dec 09, 2017 4:33 pm 
Lives in gote

Posts: 611
Location: Austin, Texas, USA
Liked others: 43
Was liked: 201
I see you point out that in general SGF files can do almost anything. But in trying to handle all SGF file types, Sabaki doesn't support LeelaZero (or AQ and others like it). I propose you parse the SGF and determine if it is a normal game with simple moves (no position setup, removing/overwriting etc). In that case play back the moves to the engine as normal. At least this will allow it to work with LeelaZero.

ETA: Maybe someone (I nominate you? :mrgreen: ) can define some GTP command extensions. Something like explain_move or dump_analysis, and it returns an SGF string containing moves the engine analyzed. If it's SGF the engine would be free to annotate those variations with whatever text it likes describing winrates etc.

ETA2: Also a command like winrate that returns the engine's position evaluation.

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #5 Posted: Mon Dec 11, 2017 10:13 am 
Beginner

Posts: 11
Liked others: 0
Was liked: 2
Rank: ogs 12kyu
Universal go server handle: qianyilong
yishn wrote:
But I see why replaying with correct move order is important. I'm open to solutions.


My two cents on a simple solution. Perhaps when you configure a new engine you could have a simple toggle that configures strict ordering. You can enable strict ordering for engines that need it and leave it off for those that don't.

I personally hate the proliferation of switches and toggles from a software dev perspective because they often introduce more spots for bugs and problems but sometimes it is the lesser of two evils.

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #6 Posted: Sat Jan 06, 2018 1:55 pm 
Dies with sente
User avatar

Posts: 91
Liked others: 21
Was liked: 17
KGS: 2k
Tygem: 2d
IGS: 1k
Wbaduk: 2d
OGS: 1K
Hi!
I use Leela and LeelaZero on Sabaki a lot with no trouble. I love Sabaki and really was looking forward to use LeelaSabaki as well, but somehow I can't seem to find the way to run it :sad:
I've tried to type many things, like:
--flat --help C:\Users\Dontbtme\Downloads\Sauvegarde\Jeu de go\Logiciels\leelasabaki-v0.2.0\Leela0110GTP_OpenCL.exe --gtp --noponder
I've tried with the <> and [] used in the explanations, or with and without the --gtp, etc.
Anyway, even though I suspect the answer might be obvious, I'm becoming more and more desperate :oops:
What am I doing wrong? :sad:

_________________
Bored with skillful play? Watch my blunders on my YouTube Channel


Last edited by Dontbtme on Mon Jan 08, 2018 7:55 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #7 Posted: Mon Jan 08, 2018 7:02 am 
Dies in gote
User avatar

Posts: 57
Location: Germany
Liked others: 0
Was liked: 14
Rank: 4 kyu
Dontbtme wrote:
Hi!
I use Leela and LeelaZero on Sabaki a lot with no trouble. I love Sabaki and really was looking forward to use LeelaSabaki as well, but somehow I can't seem to find the way to run it :sad:
I've tried to type many things, like:
--flat --help C:\Users\Ra\Downloads\Sauvegarde\Jeu de go\Logiciels\leelasabaki-v0.2.0\Leela0110GTP_OpenCL.exe --gtp --noponder
I've tried with the <> and [] used in the explanations, or with and without the --gtp, etc.
Anyway, even though I suspect the answer might be obvious, I'm becoming more and more desperate :oops:
What am I doing wrong? :sad:


You should remove the '--help' option, as it will only print a help note and therefore not enter GTP mode.

Did you try to put the path to Leela in quotation marks? It seems like you have spaces in your path. Also, you can try running LeelaSabaki in the command line to see what error messages it writes.

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #8 Posted: Mon Jan 08, 2018 7:54 am 
Dies with sente
User avatar

Posts: 91
Liked others: 21
Was liked: 17
KGS: 2k
Tygem: 2d
IGS: 1k
Wbaduk: 2d
OGS: 1K
I tried all the above and... that's it! :bow:
For the curious and the helpless like me, here's the working line (in my case):
--flat "C:\Users\Dontbtme\Downloads\Sauvegarde\Jeu de go\Logiciels\leelasabaki-v0.2.0\Leela0110GTP_OpenCL.exe" --noponder
I just tried it a bit, but I can already tell I'll use LeelaSabaki a lot :D
Oh, and being able to flatten or not the variations is an awesome idea, depending on how we intend to use the sgf file later on :tmbup:
Thanks a lot for this great tool!

_________________
Bored with skillful play? Watch my blunders on my YouTube Channel

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #9 Posted: Mon Jan 08, 2018 3:14 pm 
Dies in gote
User avatar

Posts: 57
Location: Germany
Liked others: 0
Was liked: 14
Rank: 4 kyu
I've just released a new version of LeelaSabaki (together with a new version of Sabaki) which lets you visualize network probabilities from Leela in Sabaki as heatmaps.

Attachment:
File comment: LeelaSabaki heatmap
leelasabaki-heatmap.png
leelasabaki-heatmap.png [ 433.84 KiB | Viewed 3600 times ]


This post by yishn was liked by: Waylon
Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #10 Posted: Mon Jan 08, 2018 9:56 pm 
Lives with ko

Posts: 246
Liked others: 62
Was liked: 124
Rank: OGS 7 kyu
yishn wrote:
I've just released a new version of LeelaSabaki (together with a new version of Sabaki) which lets you visualize network probabilities from Leela in Sabaki as heatmaps.
The result looks nice!

_________________
I am the author of GoReviewPartner, a small software aimed at assisting reviewing a game of Go. Give it a try!

Top
 Profile  
 
Offline
 Post subject: navigation error?
Post #11 Posted: Thu Feb 08, 2018 7:37 pm 
Lives in gote
User avatar

Posts: 392
Liked others: 23
Was liked: 43
Rank: NR
first time trying out Sabaki tree navigation, i found that right arrow didn't do what i expected; i wanted to hop to the next branch from the red node, but instead it jumped back and then across, taking me into a different variation.
qianyilong wrote:
I personally hate the proliferation of switches and toggles
second that; it's hard to provide functionality and obviousness at one and the same time, but in general i think its better to be obvious than not. like, who the heck would expect that Alt is a magic button to see a menu? menus dont take up that much space, so should be always visible.

PS. policy net probabilities or win%? of the two, the only one that interests me is win%

_________________
i shrink, therefore i swarm

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #12 Posted: Fri Feb 23, 2018 4:58 am 
Dies with sente
User avatar

Posts: 91
Liked others: 21
Was liked: 17
KGS: 2k
Tygem: 2d
IGS: 1k
Wbaduk: 2d
OGS: 1K
So, thanks to LeelaSabaki I had a lot of fun reviewing my games from LeelaZero's point of view :D
Here's my thoughts as to this particular use: When I ask LeelaZero what it would play, it usually considers a lot of candidate moves, showing numerous variations as a result... The thing is: I intend on keeping a neat review to look at again in the future, so I end up trimming off each time any variations BUT the best one. On the other hand, if there was some command I could type in "Manage Engine" ordering LeelaSabaki to show only a given number of variations (1 in my case), I wouldn't have to trim off anything.
That was my two cents, but anyway: LeelaSabaki (and Sabaki for that matter) is a really cool tool already, so thanks a lot for making and sharing it! :tmbup:

_________________
Bored with skillful play? Watch my blunders on my YouTube Channel

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #13 Posted: Sat May 05, 2018 3:56 am 
Dies with sente

Posts: 107
Liked others: 27
Was liked: 11
Rank: KGS 6 dan
I have one Sabaki question, so maybe it's a bit off topic. But is it possible to have the screen automatically maximized when Sabaki opens up?

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #14 Posted: Mon May 07, 2018 1:00 pm 
Dies in gote
User avatar

Posts: 68
Liked others: 52
Was liked: 6
Rank: OGS 25k
OGS: sleepyEDB
So much great software available for training and reviewing. I already really liked sabaki as an SGF editor so I'll make sure to try this out. Thank you!


sleepy

_________________
Playing since: March 2018
The road of life is rocky, and you may stumble too. So while you point your finger, someone else is judging you. --Bob Marley

Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #15 Posted: Thu Jun 14, 2018 4:22 am 
Beginner
User avatar

Posts: 14
Liked others: 8
Was liked: 0
Nice project! I like Sabaki very much and would like to use it with Leela to review games (as the common Leela GUI doesn't let you do so). Unfortunately I'm having some trouble, as Leela does not seem to respond.

At first I just generated a new game and attached Leela to white. After I play a move with black you can see her recognizing it in the console and the "beach ball"-cursor indicates the program is working but even after 5-10min it doesn't play a move. I then changed the --playouts parameter to 10 but it didn't work either. I tried with and without the --gtp but nothing works (I'll attach a screenshot below).

The same goes for reviewing games. If i attach Leela to let's say the color i played, i can skip through the game but i don't any variations or suggested moves. If i type the "heatmap" command into the console still nothing happens. If i generate a move or attach the engine to both players the result is the same as if i start a game against Leela.

Am i missing something important while setting it up? :scratch:


Attachments:
Bildschirmfoto 2018-06-14 um 13.07.33.png
Bildschirmfoto 2018-06-14 um 13.07.33.png [ 249.65 KiB | Viewed 1474 times ]
Top
 Profile  
 
Offline
 Post subject: Re: LeelaSabaki - Leela integration with Sabaki
Post #16 Posted: Thu Sep 13, 2018 7:08 am 
Dies with sente

Posts: 121
Liked others: 104
Was liked: 2
Rank: 5k DGS
Online playing schedule: DGS always
Hi all. I am struggling downloading and installing leela zero. I install sabaki board, I try to syncronize, I tried to follow instructions but I can't have leela zero on my PC, it never never get installed.

I ask for some help: I just search for a protocol/to do list to install it from scratch like the simple leela (original version) plain and simple, with heatmap to analyze my games without anything let to "common computer science sense" because I have bad feeling with computers.

I think that this will help more people in my situation.

Thanks in advance

PS: It doesn't work because leelaSabaki has a too strange extension i belive

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 16 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Bing [Bot] and 4 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group