It is currently Fri Mar 29, 2024 7:24 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 10 posts ] 
Author Message
Offline
 Post subject: LeelaZero's "under the stones" strategy
Post #1 Posted: Thu May 24, 2018 2:00 pm 
Lives in gote

Posts: 388
Liked others: 416
Was liked: 198
This is a training game from LeelaZero from yesterday.
It lasted for 623 moves!
What I found even more interesting was LeelaZero's "under the stones" strategy with black - see move 365 for instance, where instead of capturing two stones with P9 (which is not enough to win for black), it fills in a point, lets white capture that huge group, then later starts playing in the empty area created by the capture in an attempt to narrow the gap :-)

Black does that several times in fact, with multiple groups, ending up with all the stones dead.

Somebody should tell LeelaZero that this strategy doesn't work :-)


_________________
Sorin - 361points.com

Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #2 Posted: Thu May 24, 2018 2:07 pm 
Lives in gote

Posts: 502
Liked others: 1
Was liked: 153
Rank: KGS 2k
GD Posts: 100
KGS: Tryss
Pretty normal. I mean, black is not allowed to resign, and passing when you're behind is the worse possible move, so it makes sense black try stupid things.


This post by Tryss was liked by: sorin
Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #3 Posted: Thu May 24, 2018 3:08 pm 
Lives in gote

Posts: 388
Liked others: 416
Was liked: 198
Tryss wrote:
Pretty normal. I mean, black is not allowed to resign, and passing when you're behind is the worse possible move, so it makes sense black try stupid things.


I see - but why doesn't white pass earlier?

Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #4 Posted: Thu May 24, 2018 3:56 pm 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
sorin wrote:
This is a training game from LeelaZero from yesterday.
It lasted for 623 moves!
What I found even more interesting was LeelaZero's "under the stones" strategy with black - see move 365 for instance, where instead of capturing two stones with P9 (which is not enough to win for black), it fills in a point, lets white capture that huge group, then later starts playing in the empty area created by the capture in an attempt to narrow the gap :-)

Black does that several times in fact, with multiple groups, ending up with all the stones dead.

Somebody should tell LeelaZero that this strategy doesn't work :-)


Given the playing level of LeelaZero, I find it hard to believe that this is a new phenomenon. It sounds like what Freud might call the return of the repressed. ;) It may be an example of the loss of learning during a time of drift, in which successive winners are not actually improvements. It is not very serious, as Black simply lost a lost game. And I expect that LeelaZero will soon learn that Black's strategy does not actually increase already remote chances of winning.

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #5 Posted: Thu May 24, 2018 4:15 pm 
Lives in gote

Posts: 502
Liked others: 1
Was liked: 153
Rank: KGS 2k
GD Posts: 100
KGS: Tryss
Quote:
And I expect that LeelaZero will soon learn that Black's strategy does not actually increase already remote chances of winning.

No chance.

I mean, if Black pass, its winrate is exactly 0%. If black has 0.000001% chance to win by playing, then it's logical to play. LZ has no reason to learn to pass like we humans do.




Here in this training game (less than 7 days ago) LZ only passed because it didn't have a legal move available

Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #6 Posted: Thu May 24, 2018 4:52 pm 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Tryss wrote:
Quote:
And I expect that LeelaZero will soon learn that Black's strategy does not actually increase already remote chances of winning.

No chance.

I mean, if Black pass, its winrate is exactly 0%. If black has 0.000001% chance to win by playing, then it's logical to play. LZ has no reason to learn to pass like we humans do.


You mean that as long as there is one win in its playouts, the player who is behind will not pass?

But the players can pass, so presumably there may be a playout that begins with a pass, yet the player still wins. So we cannot say that if Black passes its win rate is 0.

Quote:
Here in this training game (less than 7 days ago) {sgf omitted} LZ only passed because it didn't have a legal move available


Well, in the game shown by sorin Black passed with legal moves available at move 421, without committing seppuku. As sorin says,
sarin wrote:
but why doesn't white pass earlier?
I.e., at move 422.

Has LeelaZero always played like this, or is it just that sorin did not notice until now?

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #7 Posted: Thu May 24, 2018 5:51 pm 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
Click Here To Show Diagram Code
[go]$$Wcm20 Not a mistake?
$$ ---------------------------------------
$$ | X . X O O O O O O O . O O . O O . O . |
$$ | . X X X O . O O X X O O O O O O O . O |
$$ | X . X O O O O O O X X O O O O O O O O |
$$ | . X X O X O O O O X X O O O O O . O O |
$$ | X X X O X X X X X . X X O O O O X . X |
$$ | X X O X X X O O X X . O O O O X X . O |
$$ | X O O O X O O O X X X X O X X O O X O |
$$ | O 1 O a O O O O X X X X O O X O O O O |
$$ | O O O O X O . O X X O O O O . . O . O |
$$ | O O O X X X O O X O . O X . O X X O O |
$$ | O X O X . X X X O O X O . O O O O . O |
$$ | X X X X X O O O O O O O X X O O . O O |
$$ | X X X X . X O O O O O . X O O . X O O |
$$ | X X X . X X O O O O O . X O . O X O O |
$$ | X X . X X O O O . O O O O . O O O . O |
$$ | X X X X X O O O . , O . . O . O O O O |
$$ | X X X X O O O O O O O O . O X O X X X |
$$ | X X X X O X O . O . O O O O O O O X . |
$$ | X X X X X X O O . O O O . O . O X X X |
$$ ---------------------------------------[/go]


White 420 commits seppuku. Sure, White can still win. But can anybody claim with a straight face that filling an eye needed for life increases White's chances of winning in any meaningful way?

Then Black 421 passes. :shock: Does that give her better chances than capturing at "a"?

Click Here To Show Diagram Code
[go]$$Bcm29 Not mistakes? Really?
$$ ---------------------------------------
$$ | X . X O O O O O O O 4 O O . O O . O . |
$$ | . X X X O . O O X X O O O O O O O . O |
$$ | X . X O O O O O O X X O O O O O O O O |
$$ | . X X O X O O O O X X O O O O O . O O |
$$ | X X X O X X X X X 1 X X O O O O X . X |
$$ | X X O X X X O O X X . O O O O X X . O |
$$ | X O O O X O O O X X X X O X . O O X O |
$$ | O O O a O O O O X X X X O O . O O O O |
$$ | O O O O X O . O X X O O O O O . O . O |
$$ | O O O X X X O O X O . O X . O X X O O |
$$ | O X O X . X X X O O X O O O O O O . O |
$$ | X X X X X O O O O O O O X X O O . O O |
$$ | X X X X . X O O O O O . X O O . X O O |
$$ | X X X . X X O O O O O 3 X O . O X O O |
$$ | X X . X X O O O . O O O O . O O O . O |
$$ | X X X X X O O O X X O . . O . O O O O |
$$ | X X X X O O O O O O O O . O X O . . . |
$$ | X X X X O X O . O . O O O O O O O . O |
$$ | X X X X X X O O . O O O . O . O . . . |
$$ ---------------------------------------[/go]

:w30: = pass

Later, Black 429 puts her head on the chopping block instead of capturing at "a". White 430 does not deliver the coup de grace, but passes. :roll: {no longer shocked}. Then both players continue to avoid capturing the opponent's large group while saving their own. White finally captured the Black group at move 450.

Does no one think that Leela Zero has things to learn here?

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.


Last edited by Bill Spight on Thu May 24, 2018 6:15 pm, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #8 Posted: Thu May 24, 2018 6:09 pm 
Gosei

Posts: 1590
Liked others: 886
Was liked: 527
Rank: AGA 3k Fox 3d
GD Posts: 61
KGS: dfan
Bill Spight wrote:
Has LeelaZero always played like this, or is it just that sorin did not notice until now?

My impression is that Leela Zero was more reasonable about passing until it started learning from the games of ELF, who passes a lot less (my understanding is that the ELF code handled passing specially, while Leela Zero learned it naturally in its neural network).

Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #9 Posted: Thu May 24, 2018 6:17 pm 
Honinbo

Posts: 10905
Liked others: 3651
Was liked: 3374
dfan wrote:
Bill Spight wrote:
Has LeelaZero always played like this, or is it just that sorin did not notice until now?

My impression is that Leela Zero was more reasonable about passing until it started learning from the games of ELF, who passes a lot less (my understanding is that the ELF code handled passing specially, while Leela Zero learned it naturally in its neural network).


Thanks. :)

_________________
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.

Top
 Profile  
 
Offline
 Post subject: Re: LeelaZero's "under the stones" strategy
Post #10 Posted: Thu May 24, 2018 6:21 pm 
Oza
User avatar

Posts: 2401
Location: Tokyo, Japan
Liked others: 2338
Was liked: 1332
Rank: Jp 6 dan
KGS: ez4u
Discussion here: https://github.com/gcp/leela-zero/issues/1446

_________________
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 10 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Bing [Bot] and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group