It is currently Sun Jul 15, 2018 3:52 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 64 posts ]  Go to page Previous  1, 2, 3, 4
Author Message
Offline
 Post subject: Re: Questions about a game
Post #61 Posted: Tue Jul 10, 2018 2:17 pm 
Tengen

Posts: 4914
Location: Cambridge, UK
Liked others: 248
Was liked: 2503
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Interesting find Bill. The obvious interpretation to me of chucking more win% on moves with more time is that these are harder moves and despite spending the extra time the chosen play was quite some way off Leela's best move. If less time had been taken maybe it would have been even worse (or maybe better, sometimes it is possible to overthink and come up with a worse move than your intuition). The next step would be doing a similar analysis with another bot. If a similar pattern is found then that is saying the two bots agree on which moves were good and which were bad, so the "spending more time on hard moves and still not playing so well" hypothesis is strengthened. I'm not sure what it means if such a correlation is not found. The absolute win% differences of another bot are not so important, what Leela calls a 2% mistake LeelaElf might call a 10% because is stronger and has more extreme opinions, it's the relative difference between fast and slow moves that is.

Top
 Profile  
 
Offline
 Post subject: Re: Questions about a game
Post #62 Posted: Tue Jul 10, 2018 4:44 pm 
Judan

Posts: 7269
Liked others: 1860
Was liked: 2634
Uberdude wrote:
Interesting find Bill. The obvious interpretation to me of chucking more win% on moves with more time is that these are harder moves and despite spending the extra time the chosen play was quite some way off Leela's best move.


Carlo took the most time on move 37, almost 4 min. Do we really think that Carlo, if cheating, let Leela run that long because he thought the move was difficult, and then did not choose Leela's best move over one that Leela (probably) said was decidedly inferior? If living in the corner in gote was Leela's best choice after 4 min., then maybe the eye-stealing tesuji, which Cieply's Leela came up with both times after more than 200K rollouts, was a mistake, as was Leela's assessment, in analysis, that Leela's later choice chucked 3.08% or 2.54%, depending on the analysis run. Of course, that is possible, as is the possibility that Leela simply overthought the position. ;) I suppose that it is possible for a top bot to overthink, but that's not the way to bet. That still leaves the question in my mind, if cheating, why did Carlo let Leela run that long? For instance, if he was running Ales's Leela, it would have told him that living immediately in the corner would have turned a likely win into a likely loss, and Bojanic's Leela would have told him the same thing, but also would have said that his play would have lost 7% pts. :shock:


Quote:
The next step would be doing a similar analysis with another bot.


Yes! :D And doing it as I suggest, by making both Carlo's play and the play suggested by the bot, and comparing those results.

_________________
The Adkins Principle:

At some point, doesn't thinking have to go on?

— Winona Adkins

Top
 Profile  
 
Offline
 Post subject: Re: Questions about a game
Post #63 Posted: Tue Jul 10, 2018 10:51 pm 
Dies with sente

Posts: 91
Liked others: 19
Was liked: 65
Rank: 5 dan
Bill Spight wrote:
Carlo took the most time on move 37, almost 4 min. Do we really think that Carlo, if cheating, let Leela run that long because he thought the move was difficult, and then did not choose Leela's best move over one that Leela (probably) said was decidedly inferior? If living in the corner in gote was Leela's best choice after 4 min., then maybe the eye-stealing tesuji, which Cieply's Leela came up with both times after more than 200K rollouts, was a mistake, as was Leela's assessment, in analysis, that Leela's later choice chucked 3.08% or 2.54%, depending on the analysis run. Of course, that is possible, as is the possibility that Leela simply overthought the position. ;)

Bill,
you forgot one important thing - Leela is not good in L&D, as shown in game from qualification that was also analyzed.
It made terrible mistake, and it took Metta long time to recover.

Long time for thinking on this move could be very easily explained - Metta played it, he was not confident in Leela after previous mistake.

Top
 Profile  
 
Offline
 Post subject: Re: Questions about a game
Post #64 Posted: Wed Jul 11, 2018 1:31 am 
Judan

Posts: 7269
Liked others: 1860
Was liked: 2634
Bojanic wrote:
Bill Spight wrote:
Carlo took the most time on move 37, almost 4 min. Do we really think that Carlo, if cheating, let Leela run that long because he thought the move was difficult, and then did not choose Leela's best move over one that Leela (probably) said was decidedly inferior? If living in the corner in gote was Leela's best choice after 4 min., then maybe the eye-stealing tesuji, which Cieply's Leela came up with both times after more than 200K rollouts, was a mistake, as was Leela's assessment, in analysis, that Leela's later choice chucked 3.08% or 2.54%, depending on the analysis run. Of course, that is possible, as is the possibility that Leela simply overthought the position. ;)

Bill,
you forgot one important thing - Leela is not good in L&D, as shown in game from qualification that was also analyzed.
It made terrible mistake, and it took Metta long time to recover.

Long time for thinking on this move could be very easily explained - Metta played it, he was not confident in Leela after previous mistake.


Actually, you are agreeing with me. It is unlikely that Metta would take a long time on :b37: if he were going to use Leela to decide on which move to play, because Leela is bad at life and death questions. So he did his own thinking for this play. :)

_________________
The Adkins Principle:

At some point, doesn't thinking have to go on?

— Winona Adkins

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 64 posts ]  Go to page Previous  1, 2, 3, 4

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 3 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group