Life In 19x19
http://lifein19x19.com/

Win Rates and Visits in ELF
http://lifein19x19.com/viewtopic.php?f=18&t=16322		 Page 1 of 1
Author:  hyperpape [ Mon Dec 24, 2018 10:53 am ]
Post subject:  Win Rates and Visits in ELF
In MCTS, you expect that given adequate time, the move with the highest win percentage will also have the most visits. Is this also true for ELF? If so, how long would you expect it to take for the two to converge? I have failed to see it after a few thousand playouts, but I suppose that’s not that many.
Author:  Uberdude [ Mon Dec 24, 2018 3:22 pm ]
Post subject:  Re: Win Rates and Visits in ELF
A few thousand is tiny. If I want to do some serious analysis of a position I'll give Elf 50-100k playouts.
Author:  moha [ Mon Dec 24, 2018 4:32 pm ]
Post subject:  Re: Win Rates and Visits in ELF
hyperpape wrote:
In MCTS, you expect that given adequate time, the move with the highest win percentage will also have the most visits.
I don't think this is necessarily true, only if search did not find new moves in upper levels (or important followups below them) for a while, and there are no close candidates.

But generally, both visits and winrates will lag behind latest knowledge, only in different ways (visits can only accumulate slowly, winrates can only change by averaging into them).
Author:  hyperpape [ Wed Mar 06, 2019 11:12 am ]
Post subject:  Re: Win Rates and Visits in ELF
Good point, moha. In this case, however, it's a relatively quiet opening position, with no major changes in the win percentages for each move as the simulations proceed. I'll try to post examples soon.

Uberdude: I'm aware it's a smallish simulation, but this is a "low level" property. By that, I mean I'm not asking "why isn't the engine seeing a particular move or evaluating things in the right way?" What I'm asking is "why isn't it adequately exploring the move it gives the highest percentage chance?" I would think it would not have required that many simulations. Maybe I need to work some examples with the formula from Remi's paper to get a better intuition for how fast a move will be explored.
Page 1 of 1 All times are UTC - 8 hours [ DST ]
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/