Life In 19x19 :: What about the komi discussion, now that KataGo is coming

6.5 komi chinese rules is actually more appropriate than 7.5?

Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white.

Yakago wrote:

Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white.

However - if you repeat the experiment with zero komi, it thinks Black has a 9.1 point advantage on the empty board.

Chinese rules with 7.5 komi is equivalent to Japanese/Korean with either 6.5 or 7.5 komi

Have more experiments been carried out? Are there more conclusive statements on fair komi by looking at LZ's probabilities or KataGo's scoring?

Knotwilg wrote:

Have more experiments been carried out? Are there more conclusive statements on fair komi by looking at LZ's probabilities or KataGo's scoring?

We need new and fair komi!!!

When I run strongest Leela on my super machine:
12944050 playouts (analysis stops every time automatically and this is detritus) = more playouts are not possible:(
Black: 43% chance to win.
White: 57% chance to win.

Or in my words to be more clear 40% vs 60% or (4/10 vs 6/10) vs (40 = 66% vs 60 = 100%).
I think your know when I mean;)

With fractional komi the strongest bots will always show skewed winrates. That unfair half point does matter at high levels.

Why would it be more likely that 7,5 results in skewed winrates than 7?

Suppose that a komi of 7 gives Black 55%

Otherwise common sense would predict 7.5 is worse: correct komi is 7 and it is better to let B win ties than W, since practical players are not close to correct/perfect play thus need slightly less komi.

Author:	Yakago [ Sun Jun 30, 2019 2:04 pm ]
Post subject:	What about the komi discussion, now that KataGo is coming
I managed to make KataGo analysis work on my pc, by gathering a few bits from the github pages of katago and lizzie Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white. Someone might correct me, but from my understanding, Chinese rules with 7.5 komi is equivalent to Japanese/Korean with either 6.5 or 7.5 komi depending on who gets the last dame. If KataGo is 'correct', does this mean that 6.5 komi chinese rules is actually more appropriate than 7.5?

Author:	EdLee [ Sun Jun 30, 2019 3:09 pm ]
Post subject:
Quote: 6.5 komi chinese rules is actually more appropriate than 7.5? The odd number (5,7,etc.) is related to the odd-numbered 361 board.

Author:	moha [ Sun Jun 30, 2019 4:21 pm ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
There is little difference between 5.5 and 6.5 for Chinese. I'm not sure why they switched from 5.5 to 7.5 but I guess there were some statistical reasons. Otherwise common sense would predict 7.5 is worse: correct komi is 7 and it is better to let B win ties than W, since practical players are not close to correct/perfect play thus need slightly less komi.

Author:	bernds [ Sun Jun 30, 2019 6:53 pm ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
Yakago wrote: Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white. However - if you repeat the experiment with zero komi, it thinks Black has a 9.1 point advantage on the empty board.

Author:	gennan [ Sun Jun 30, 2019 11:52 pm ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
bernds wrote: Yakago wrote: Now KataGo has a 'score estimation' network, and who would have thought - the evaluation of an empty board with chinese rules and 7.5 komi is a 1.2 points advantage for white. However - if you repeat the experiment with zero komi, it thinks Black has a 9.1 point advantage on the empty board. But if white tries to win with zero komi, he has to try risky things, which leads to greater disadvantage if black counters well. If instead of trying to win, white tries to minimize the score difference, you may get different results. I think the average score difference would be smaller.

Life In 19x19 http://lifein19x19.com/

What about the komi discussion, now that KataGo is coming http://lifein19x19.com/viewtopic.php?f=18&t=16730	Page 1 of 1

Author:	RobertJasiek [ Mon Jul 01, 2019 12:10 am ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
Yakago wrote: Chinese rules with 7.5 komi is equivalent to Japanese/Korean with either 6.5 or 7.5 komi You are wrong, see https://lifein19x19.com/viewtopic.php?p=246387#p246387

Author:	Knotwilg [ Thu Dec 05, 2019 9:26 am ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
Have more experiments been carried out? Are there more conclusive statements on fair komi by looking at LZ's probabilities or KataGo's scoring?

Author:	goame [ Thu Dec 05, 2019 2:08 pm ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
Knotwilg wrote: Have more experiments been carried out? Are there more conclusive statements on fair komi by looking at LZ's probabilities or KataGo's scoring? We need new and fair komi!!! When I run strongest Leela on my super machine: 12944050 playouts (analysis stops every time automatically and this is detritus) = more playouts are not possible:( Black: 43% chance to win. White: 57% chance to win. Or in my words to be more clear 40% vs 60% or (4/10 vs 6/10) vs (40 = 66% vs 60 = 100%). I think your know when I mean;)

Author:	bayu [ Thu Dec 05, 2019 3:18 pm ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
A single 40:60 statement isn't worth a lot in my understanding. The question is what happens if you lower the komi. If you lower the komi by one and end up with 70:30, the original komi was a fairer one. I don't think it is possible to achieve 50:50 winning chance anyway. And the stronger the bots get the more skewed will be the winning chances on the empty board. The question is, what komi leads to the least skewed winning chances. It will depend on the ruleset, and I expect that button go will turn out to be the optimal solution.

Author:	Bill Spight [ Fri Dec 06, 2019 1:04 am ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
Back in 1977 (if I remember the date correctly) the American Go Journal published an article that claimed, based upon statistics published by the Nihon Kiin of 1400 recent pro games at 4½ pt. komi and 1400 at 5½ pt. komi or 5 pt. komi with White winning jigo, that the correct komi is 7. Terry Benson sent me the article to review before publication, along with the data. For each set of 1400 games the komi which came closest to a 50:50 split was 6½ pts. As I recall, the percentage difference in wins for a one pt. difference in komi around a 6½ pt. komi was less than 3%, That proved to be enough of a winrate difference for the Japanese to raise komi to 6½ pts., but it took them more than 25 years to do so.

Author:	Bill Spight [ Fri Dec 06, 2019 1:07 am ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
goame wrote: Knotwilg wrote: Have more experiments been carried out? Are there more conclusive statements on fair komi by looking at LZ's probabilities or KataGo's scoring? We need new and fair komi!!! When I run strongest Leela on my super machine: 12944050 playouts (analysis stops every time automatically and this is detritus) = more playouts are not possible:( Black: 43% chance to win. White: 57% chance to win. Or in my words to be more clear 40% vs 60% or (4/10 vs 6/10) vs (40 = 66% vs 60 = 100%). I think your know when I mean;) What happens with a 9½ pt. komi?

Author:	luigi [ Fri Dec 06, 2019 4:42 am ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
goame wrote: We need new and fair komi!!! When I run strongest Leela on my super machine: 12944050 playouts (analysis stops every time automatically and this is detritus) = more playouts are not possible:( Black: 43% chance to win. White: 57% chance to win. Or in my words to be more clear 40% vs 60% or (4/10 vs 6/10) vs (40 = 66% vs 60 = 100%). I think your know when I mean;) AlphaZero confirms this. In the 1000-game match between AlphaZero and AlphaGo Zero, White won 57.6% of the time, as reported by DeepMind. (However, there must be a slight mistake in their numbers. For example, they say AlphaZero won 68.9% of its games as White, but that would mean 344.5 games out of 500. Where does the half game come from? They don't report any drawn games, and supposedly superko was used. Same thing with AlphaZero's games as Black. The decimal place in the percentages should be an even number.)

Author:	jann [ Fri Dec 06, 2019 5:41 am ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
With fractional komi the strongest bots will always show skewed winrates. That unfair half point does matter at high levels.

Author:	Knotwilg [ Fri Dec 06, 2019 6:14 am ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
jann wrote: With fractional komi the strongest bots will always show skewed winrates. That unfair half point does matter at high levels. I don't think that makes a difference at all. Why would it be more likely that 7,5 results in skewed winrates than 7? Suppose that a komi of 7 gives Black 55% and a komi of 8 gives 45%. Isn't it then to be expected that a komi of 7,5 will give 50%?

Page 1 of 1	All times are UTC - 8 hours [ DST ]
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group http://www.phpbb.com/

Author:	jann [ Fri Dec 06, 2019 7:51 am ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
Knotwilg wrote: Why would it be more likely that 7,5 results in skewed winrates than 7? Because top bots are within a few stones to perfect play (which gives 50% with integer komi). In any case, as bots gets stronger, any komi flaws will get amplified towards 100% or 0%. Quote: Suppose that a komi of 7 gives Black 55% This doesn't seem likely at today's bot levels already. Actually, hard to imagine at any level.

Author:	hyperpape [ Fri Dec 06, 2019 1:13 pm ]
Post subject:	Re: What about the komi discussion, now that KataGo is comin
moha wrote: Otherwise common sense would predict 7.5 is worse: correct komi is 7 and it is better to let B win ties than W, since practical players are not close to correct/perfect play thus need slightly less komi. I've long been cautious about this assumption. It certainly is possible, but I'm not sure that anyone has demonstrated that it's true. Reading this, it just occurred to me to wonder if we could analyze training data for AI to test this idea.