It is currently Tue Mar 19, 2024 4:09 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 19 posts ] 
Author Message
Offline
 Post subject: Is Leela good enough to use as a "review partner"?
Post #1 Posted: Wed Oct 18, 2017 3:26 pm 
Lives in gote
User avatar

Posts: 308
Liked others: 54
Was liked: 71
Rank: EGF 5k Foxy 2k
I played a quick game, I don't play much these days, but I like to play now and again. It was quite scrappy. I was reviewing it myself for a bit, some quick thoughts:

- I wasn't sure if I could do something better in the opening in the top right
- I made a mistake in the opening by losing 3 stones
- I fought back using the opponent's weak groups
- My opponent made some "toothpaste" mistakes as Ed Lee would say
- I was "playing loose" with some weak groups (e.g. on the right side) and my opponent could have cut me up good and proper I think
- If I hadn't managed to capture the opponent's bottom-left group, the game would have been quite close

After I had a 10 minute look after the game, I loaded it in Leela and clicked through on analysis mode. What do you think of engines as "review partners" to be used after a self-review to affirm or reject ideas that I had during the review? Are they strong enough to do this in your opinion?

Here is the game.



Attachments:
review.sgf [5.35 KiB]
Downloaded 1284 times

_________________
12k: 2015.08.11; 11k: 2015.09.13; 10k: 2015.09.27; 9k: 2015.10.10; 8k: 2015.11.08; 7k: 2016.07.10 6k: 2016.07.24 5k: 2018.05.14 4k: 2018.09.03 3k: who knows?

This post by Jujube was liked by: mvk20
Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #2 Posted: Wed Oct 18, 2017 3:41 pm 
Lives in sente

Posts: 902
Location: Fort Collins, CO
Liked others: 319
Was liked: 287
Rank: AGA 3k
Universal go server handle: jeromie
Leela is absolutely strong enough to be a useful review partner. This doesn’t mean you can use every suggested move (you may not be strong enough for the follow up), but it can at least help you identify major mistakes, get new ideas, and know whether you were ahead or behind at any given point.


This post by jeromie was liked by: mvk20
Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #3 Posted: Thu Oct 19, 2017 8:03 am 
Dies in gote
User avatar

Posts: 46
Liked others: 20
Was liked: 2
Rank: IGS 14k+
KGS: mvk20
IGS: mvk20
DGS: mvk20
OGS: mvk20
Universal go server handle: mvk20
When you are replaying and analyzing a game with Leela, is there a way for it to display what the next move actually was in the game? I can see where it shows the best move, and other candidates, the win percentages that correspond to each. But what would be really nice would be to see a list of candidates, with the actual move marked, so you could see at a glance, "Oh, I should have moved there, but I moved here instead." Or, in a best case scenario, "I should have moved there, and I actually did this time!" As it is, best I can figure out is to arrow forward, look at the move, then arrow back and let it analyze, which is pretty cumbersome. Am I missing a display option? Thanks!

Top
 Profile  
 
Offline
 Post subject:
Post #4 Posted: Thu Oct 19, 2017 8:18 am 
Honinbo
User avatar

Posts: 8859
Location: Santa Barbara, CA
Liked others: 349
Was liked: 2076
GD Posts: 312
Hi jujube, jeromie, mvk,

Is Leela available on Windows, OSX, iOS ? Thanks.

Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #5 Posted: Thu Oct 19, 2017 8:27 am 
Dies in gote

Posts: 23
Liked others: 0
Was liked: 0
Rank: 30k
This is how game reviewed by leela (using python script) could looks like, in attached files. Including win-rate chart.

Image


Attachments:
game_4_graph.pdf [13.91 KiB]
Downloaded 439 times
game_4.sgf [59.11 KiB]
Downloaded 468 times
Top
 Profile  
 
Offline
 Post subject: Re:
Post #6 Posted: Thu Oct 19, 2017 8:31 am 
Dies in gote
User avatar

Posts: 46
Liked others: 20
Was liked: 2
Rank: IGS 14k+
KGS: mvk20
IGS: mvk20
DGS: mvk20
OGS: mvk20
Universal go server handle: mvk20
EdLee wrote:
Hi jujube, jeromie, mvk,

Is Leela available on Windows, OSX, iOS ? Thanks.

Looks like Windows, macOS and Ubuntu.

Top
 Profile  
 
Offline
 Post subject:
Post #7 Posted: Thu Oct 19, 2017 8:33 am 
Honinbo
User avatar

Posts: 8859
Location: Santa Barbara, CA
Liked others: 349
Was liked: 2076
GD Posts: 312
Hi mvk,

Thanks; which version and OS are you using for Leela ?

Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #8 Posted: Thu Oct 19, 2017 8:46 am 
Gosei

Posts: 1625
Liked others: 542
Was liked: 450
Rank: senior player
GD Posts: 1000
Can you have Leela play either color in a position you set up? If so then you can ask Leela which move(s) you could play. Since Leela can't explain reasons for moves you'll have to try to see why Leela's choices are good, but that is another opportunity to learn :)


This post by gowan was liked by: Bill Spight
Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #9 Posted: Thu Oct 19, 2017 10:33 am 
Lives in gote
User avatar

Posts: 308
Liked others: 54
Was liked: 71
Rank: EGF 5k Foxy 2k
gowan wrote:
Can you have Leela play either color in a position you set up? If so then you can ask Leela which move(s) you could play. Since Leela can't explain reasons for moves you'll have to try to see why Leela's choices are good, but that is another opportunity to learn :)


You can hit the '+' button to remember the current position and then play out a variation. Then hit '-' to return to the position ('push' and then 'pop' off the stack). In analysis mode it computes the 'best' moves on the board from the current board position and displays them graphically on the board as 'hot spots' (blue, orange then red), as well as the data being in a separate window.

_________________
12k: 2015.08.11; 11k: 2015.09.13; 10k: 2015.09.27; 9k: 2015.10.10; 8k: 2015.11.08; 7k: 2016.07.10 6k: 2016.07.24 5k: 2018.05.14 4k: 2018.09.03 3k: who knows?

Top
 Profile  
 
Offline
 Post subject: Re:
Post #10 Posted: Thu Oct 19, 2017 10:35 am 
Lives in gote
User avatar

Posts: 308
Liked others: 54
Was liked: 71
Rank: EGF 5k Foxy 2k
EdLee wrote:
Hi mvk,

Thanks; which version and OS are you using for Leela ?


Not mvk, but I use Windows 10 and Leela GPU Accelerated version. On Linux (OpenSuse Tumbleweed) Leela works fine but I couldn't get it to work with the GPU drivers so was only able to use it in processor-only mode.

_________________
12k: 2015.08.11; 11k: 2015.09.13; 10k: 2015.09.27; 9k: 2015.10.10; 8k: 2015.11.08; 7k: 2016.07.10 6k: 2016.07.24 5k: 2018.05.14 4k: 2018.09.03 3k: who knows?

Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #11 Posted: Thu Oct 19, 2017 10:39 am 
Dies in gote

Posts: 23
Liked others: 0
Was liked: 0
Rank: 30k
Another example using your game


Attachments:
review_graph.pdf [15.24 KiB]
Downloaded 449 times
review_analyzed.sgf [41.59 KiB]
Downloaded 439 times
Top
 Profile  
 
Offline
 Post subject: Re: Re:
Post #12 Posted: Thu Oct 19, 2017 11:13 am 
Dies in gote
User avatar

Posts: 46
Liked others: 20
Was liked: 2
Rank: IGS 14k+
KGS: mvk20
IGS: mvk20
DGS: mvk20
OGS: mvk20
Universal go server handle: mvk20
Jujube wrote:
EdLee wrote:
Hi mvk,

Thanks; which version and OS are you using for Leela ?


Not mvk, but I use Windows 10 and Leela GPU Accelerated version. On Linux (OpenSuse Tumbleweed) Leela works fine but I couldn't get it to work with the GPU drivers so was only able to use it in processor-only mode.

I'm using the same - Windows 10, GPU Accelerated.

It really works great. When you go through analysis mode it shows the next move as a group of candidates, each with a winning percentage. It does this no matter whose turn it is. Sometimes there is only one or two candidates, sometimes a bunch. Sometimes there is one clear move better than the others, and sometimes there are many that yield close to the same percentage.

The only inconvenience I have is when looking through my own games, I can't see what the next move was. So, it's showing me what should have been played, but I can't compare that with what was actually played without moving it forward, and then it has to do the analysis all over again. That's why I was hoping there was a setting somewhere that gave a marking for the actual next move while showing the candidates for comparison.

Top
 Profile  
 
Offline
 Post subject:
Post #13 Posted: Thu Oct 19, 2017 2:38 pm 
Honinbo
User avatar

Posts: 8859
Location: Santa Barbara, CA
Liked others: 349
Was liked: 2076
GD Posts: 312
Hi mvk, jujube, Thanks.
Quote:
I can't see what the next move was.
There are two independent issues here.
The first one is the software, which seems easy enough to fix (feature to highlight original next move in the game).
The second one is the ability to recall the game;
this will become more easy with time --
usually, we can recall our own moves more easily than our opponent's,
but over time, we can even recall our opponent's moves.
(Exceptions are very memorable or weird moves, by either side. :) )

As a work-around, until they add this nice new feature,
you can study the game beforehand, noticing moves there are interesting
(yours and/or your opponent's) or questionable (where you're not sure).
After you've digested your own game somewhat,
it should be easier when you review it again in analysis mode. :study:


This post by EdLee was liked by: mvk20
Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #14 Posted: Thu Oct 19, 2017 3:36 pm 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
LOL

Original post is not a serious question?

Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #15 Posted: Fri Oct 20, 2017 6:29 am 
Gosei

Posts: 1589
Liked others: 886
Was liked: 527
Rank: AGA 3k Fox 3d
GD Posts: 61
KGS: dfan
It seemed like a serious question to me.

Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #16 Posted: Fri Oct 20, 2017 7:26 am 
Dies in gote
User avatar

Posts: 46
Liked others: 20
Was liked: 2
Rank: IGS 14k+
KGS: mvk20
IGS: mvk20
DGS: mvk20
OGS: mvk20
Universal go server handle: mvk20
I took it as a serious question - I was wondering the same myself, not just in terms of strength, but if the moves were "human" enough that it would work well as a review partner.

EdLee - definitely would be better if/when I can remember the moves of a game a bit better. That might be a while though, particularly for my games on DGS. Pretty hard for me to remember a move an opponent made a month ago or more...I found a reasonable workaround for me - view the game on my iPad as I'm analyzing it on Leela. Then I can see the game's next move, alongside a list of move(s) that work best. Two "clicks" instead of one each move, but better than forcing it to reanalyze every move. The best solution, obviously, would be a viewing option where you could tell it to display the next move if you so choose.

Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #17 Posted: Sun Oct 22, 2017 1:43 pm 
Dies with sente

Posts: 101
Liked others: 24
Was liked: 16
Try it out and decide for yourself if you like it as a review partner or not.

I like it very much: it gives me lots of new ideas to play, and it corrects my mistakes.

The only caveat: when it comes to life-and-death, you need to let it run longer since on quick analysis it may miss the status of some groups.

Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #18 Posted: Wed Oct 25, 2017 3:48 pm 
Lives in gote
User avatar

Posts: 308
Liked others: 54
Was liked: 71
Rank: EGF 5k Foxy 2k
aTan wrote:
Another example using your game


Thanks, the script is interesting. How did you interact with Leela is there an API or something? I remember that chess programs (e.g. Fritz, back in the day I had Fritz 8 when I was a chess player) used to be able to output analysed games to PDF. There would be 3 or 4 diagrams per game, and comments and variations. It would be interesting for the same kind of thing to be available as an output from a Go program; ask it to analyse the game, go to work, come home from work, and a fresh print-out of the game is by the printer ready to be looked through on a real board.

_________________
12k: 2015.08.11; 11k: 2015.09.13; 10k: 2015.09.27; 9k: 2015.10.10; 8k: 2015.11.08; 7k: 2016.07.10 6k: 2016.07.24 5k: 2018.05.14 4k: 2018.09.03 3k: who knows?

Top
 Profile  
 
Offline
 Post subject: Re: Is Leela good enough to use as a "review partner"?
Post #19 Posted: Thu Oct 26, 2017 6:26 am 
Dies in gote
User avatar

Posts: 46
Liked others: 20
Was liked: 2
Rank: IGS 14k+
KGS: mvk20
IGS: mvk20
DGS: mvk20
OGS: mvk20
Universal go server handle: mvk20
About how far to you need to let it run out to be confident that the move(s) it's giving you are indeed the best? Would that be measured in nodes?

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 19 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group