Is Leela good enough to use as a "review partner"?
- Jujube
- Lives in gote
- Posts: 308
- Joined: Sun Nov 14, 2010 8:49 am
- Rank: EGF 5k Foxy 2k
- GD Posts: 0
- Has thanked: 54 times
- Been thanked: 71 times
- Contact:
Is Leela good enough to use as a "review partner"?
I played a quick game, I don't play much these days, but I like to play now and again. It was quite scrappy. I was reviewing it myself for a bit, some quick thoughts:
- I wasn't sure if I could do something better in the opening in the top right
- I made a mistake in the opening by losing 3 stones
- I fought back using the opponent's weak groups
- My opponent made some "toothpaste" mistakes as Ed Lee would say
- I was "playing loose" with some weak groups (e.g. on the right side) and my opponent could have cut me up good and proper I think
- If I hadn't managed to capture the opponent's bottom-left group, the game would have been quite close
After I had a 10 minute look after the game, I loaded it in Leela and clicked through on analysis mode. What do you think of engines as "review partners" to be used after a self-review to affirm or reject ideas that I had during the review? Are they strong enough to do this in your opinion?
Here is the game.
- I wasn't sure if I could do something better in the opening in the top right
- I made a mistake in the opening by losing 3 stones
- I fought back using the opponent's weak groups
- My opponent made some "toothpaste" mistakes as Ed Lee would say
- I was "playing loose" with some weak groups (e.g. on the right side) and my opponent could have cut me up good and proper I think
- If I hadn't managed to capture the opponent's bottom-left group, the game would have been quite close
After I had a 10 minute look after the game, I loaded it in Leela and clicked through on analysis mode. What do you think of engines as "review partners" to be used after a self-review to affirm or reject ideas that I had during the review? Are they strong enough to do this in your opinion?
Here is the game.
- Attachments
-
- review.sgf
- (5.35 KiB) Downloaded 1488 times
12k: 2015.08.11; 11k: 2015.09.13; 10k: 2015.09.27; 9k: 2015.10.10; 8k: 2015.11.08; 7k: 2016.07.10 6k: 2016.07.24 5k: 2018.05.14 4k: 2018.09.03 3k: who knows?
-
jeromie
- Lives in sente
- Posts: 902
- Joined: Fri Jan 31, 2014 7:12 pm
- Rank: AGA 3k
- GD Posts: 0
- Universal go server handle: jeromie
- Location: Fort Collins, CO
- Has thanked: 319 times
- Been thanked: 287 times
Re: Is Leela good enough to use as a "review partner"?
Leela is absolutely strong enough to be a useful review partner. This doesn’t mean you can use every suggested move (you may not be strong enough for the follow up), but it can at least help you identify major mistakes, get new ideas, and know whether you were ahead or behind at any given point.
- mvk20
- Dies in gote
- Posts: 46
- Joined: Wed Oct 15, 2014 4:23 pm
- Rank: IGS 14k+
- GD Posts: 0
- KGS: mvk20
- IGS: mvk20
- DGS: mvk20
- OGS: mvk20
- Universal go server handle: mvk20
- Has thanked: 20 times
- Been thanked: 2 times
Re: Is Leela good enough to use as a "review partner"?
When you are replaying and analyzing a game with Leela, is there a way for it to display what the next move actually was in the game? I can see where it shows the best move, and other candidates, the win percentages that correspond to each. But what would be really nice would be to see a list of candidates, with the actual move marked, so you could see at a glance, "Oh, I should have moved there, but I moved here instead." Or, in a best case scenario, "I should have moved there, and I actually did this time!" As it is, best I can figure out is to arrow forward, look at the move, then arrow back and let it analyze, which is pretty cumbersome. Am I missing a display option? Thanks!
- EdLee
- Honinbo
- Posts: 8859
- Joined: Sat Apr 24, 2010 6:49 pm
- GD Posts: 312
- Location: Santa Barbara, CA
- Has thanked: 349 times
- Been thanked: 2070 times
Re: Is Leela good enough to use as a "review partner"?
This is how game reviewed by leela (using python script) could looks like, in attached files. Including win-rate chart.


- Attachments
-
- game_4_graph.pdf
- (13.91 KiB) Downloaded 560 times
-
- game_4.sgf
- (59.11 KiB) Downloaded 584 times
- mvk20
- Dies in gote
- Posts: 46
- Joined: Wed Oct 15, 2014 4:23 pm
- Rank: IGS 14k+
- GD Posts: 0
- KGS: mvk20
- IGS: mvk20
- DGS: mvk20
- OGS: mvk20
- Universal go server handle: mvk20
- Has thanked: 20 times
- Been thanked: 2 times
Re:
EdLee wrote:Hi jujube, jeromie, mvk,
Is Leela available on Windows, OSX, iOS ? Thanks.
Looks like Windows, macOS and Ubuntu.
- EdLee
- Honinbo
- Posts: 8859
- Joined: Sat Apr 24, 2010 6:49 pm
- GD Posts: 312
- Location: Santa Barbara, CA
- Has thanked: 349 times
- Been thanked: 2070 times
-
gowan
- Gosei
- Posts: 1628
- Joined: Thu Apr 29, 2010 4:40 am
- Rank: senior player
- GD Posts: 1000
- Has thanked: 546 times
- Been thanked: 450 times
Re: Is Leela good enough to use as a "review partner"?
Can you have Leela play either color in a position you set up? If so then you can ask Leela which move(s) you could play. Since Leela can't explain reasons for moves you'll have to try to see why Leela's choices are good, but that is another opportunity to learn 
- Jujube
- Lives in gote
- Posts: 308
- Joined: Sun Nov 14, 2010 8:49 am
- Rank: EGF 5k Foxy 2k
- GD Posts: 0
- Has thanked: 54 times
- Been thanked: 71 times
- Contact:
Re: Is Leela good enough to use as a "review partner"?
gowan wrote:Can you have Leela play either color in a position you set up? If so then you can ask Leela which move(s) you could play. Since Leela can't explain reasons for moves you'll have to try to see why Leela's choices are good, but that is another opportunity to learn
You can hit the '+' button to remember the current position and then play out a variation. Then hit '-' to return to the position ('push' and then 'pop' off the stack). In analysis mode it computes the 'best' moves on the board from the current board position and displays them graphically on the board as 'hot spots' (blue, orange then red), as well as the data being in a separate window.
12k: 2015.08.11; 11k: 2015.09.13; 10k: 2015.09.27; 9k: 2015.10.10; 8k: 2015.11.08; 7k: 2016.07.10 6k: 2016.07.24 5k: 2018.05.14 4k: 2018.09.03 3k: who knows?
- Jujube
- Lives in gote
- Posts: 308
- Joined: Sun Nov 14, 2010 8:49 am
- Rank: EGF 5k Foxy 2k
- GD Posts: 0
- Has thanked: 54 times
- Been thanked: 71 times
- Contact:
Re:
EdLee wrote:Hi mvk,
Thanks; which version and OS are you using for Leela ?
Not mvk, but I use Windows 10 and Leela GPU Accelerated version. On Linux (OpenSuse Tumbleweed) Leela works fine but I couldn't get it to work with the GPU drivers so was only able to use it in processor-only mode.
12k: 2015.08.11; 11k: 2015.09.13; 10k: 2015.09.27; 9k: 2015.10.10; 8k: 2015.11.08; 7k: 2016.07.10 6k: 2016.07.24 5k: 2018.05.14 4k: 2018.09.03 3k: who knows?
Re: Is Leela good enough to use as a "review partner"?
Another example using your game
- Attachments
-
- review_graph.pdf
- (15.24 KiB) Downloaded 573 times
-
- review_analyzed.sgf
- (41.59 KiB) Downloaded 565 times
- mvk20
- Dies in gote
- Posts: 46
- Joined: Wed Oct 15, 2014 4:23 pm
- Rank: IGS 14k+
- GD Posts: 0
- KGS: mvk20
- IGS: mvk20
- DGS: mvk20
- OGS: mvk20
- Universal go server handle: mvk20
- Has thanked: 20 times
- Been thanked: 2 times
Re: Re:
Jujube wrote:EdLee wrote:Hi mvk,
Thanks; which version and OS are you using for Leela ?
Not mvk, but I use Windows 10 and Leela GPU Accelerated version. On Linux (OpenSuse Tumbleweed) Leela works fine but I couldn't get it to work with the GPU drivers so was only able to use it in processor-only mode.
I'm using the same - Windows 10, GPU Accelerated.
It really works great. When you go through analysis mode it shows the next move as a group of candidates, each with a winning percentage. It does this no matter whose turn it is. Sometimes there is only one or two candidates, sometimes a bunch. Sometimes there is one clear move better than the others, and sometimes there are many that yield close to the same percentage.
The only inconvenience I have is when looking through my own games, I can't see what the next move was. So, it's showing me what should have been played, but I can't compare that with what was actually played without moving it forward, and then it has to do the analysis all over again. That's why I was hoping there was a setting somewhere that gave a marking for the actual next move while showing the candidates for comparison.
- EdLee
- Honinbo
- Posts: 8859
- Joined: Sat Apr 24, 2010 6:49 pm
- GD Posts: 312
- Location: Santa Barbara, CA
- Has thanked: 349 times
- Been thanked: 2070 times
Hi mvk, jujube, Thanks.
The first one is the software, which seems easy enough to fix (feature to highlight original next move in the game).
The second one is the ability to recall the game;
this will become more easy with time --
usually, we can recall our own moves more easily than our opponent's,
but over time, we can even recall our opponent's moves.
(Exceptions are very memorable or weird moves, by either side.
)
As a work-around, until they add this nice new feature,
you can study the game beforehand, noticing moves there are interesting
(yours and/or your opponent's) or questionable (where you're not sure).
After you've digested your own game somewhat,
it should be easier when you review it again in analysis mode.
There are two independent issues here.I can't see what the next move was.
The first one is the software, which seems easy enough to fix (feature to highlight original next move in the game).
The second one is the ability to recall the game;
this will become more easy with time --
usually, we can recall our own moves more easily than our opponent's,
but over time, we can even recall our opponent's moves.
(Exceptions are very memorable or weird moves, by either side.
As a work-around, until they add this nice new feature,
you can study the game beforehand, noticing moves there are interesting
(yours and/or your opponent's) or questionable (where you're not sure).
After you've digested your own game somewhat,
it should be easier when you review it again in analysis mode.