Statistically derived komidashi?

For discussing go rule sets and rule theory
User avatar
HermanHiddema
Gosei
Posts: 2011
Joined: Tue Apr 20, 2010 10:08 am
Rank: Dutch 4D
GD Posts: 645
Universal go server handle: herminator
Location: Groningen, NL
Has thanked: 202 times
Been thanked: 1086 times

Re: Statistically derived komidashi?

Post by HermanHiddema »

Matti wrote:I think we also have enough data for 7½ komi. Does some one have them at hand and be able to tell whether black still has an advantage? If yes, then we would need, say 1000 games with 8½ or preferably 9½ to know better.


At http://senseis.xmp.net/?Komi%2FStatistics there is a section I posted about 7.5 or 8.0 (Ing) komi, which has white winning 50.5% of games in a sample of 410 games from gobase.org where both players are at least 8d pro.
hyperpape
Tengen
Posts: 4382
Joined: Thu May 06, 2010 3:24 pm
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Location: Caldas da Rainha, Portugal
Has thanked: 499 times
Been thanked: 727 times

Re: Statistically derived komidashi?

Post by hyperpape »

shapenaji wrote:Addendum:
Supposing that 7 is, in fact, the correct komi. Would it be worth allowing Jigo again to make the game fairer?
A good question, and I think you can make an argument that draws should be possible in some ideal sense. But if komi suffices to reduce the advantage to less than a 52% win percent (for either White or Black), that's excellent balance. I don't find it worth tolerating a 5% chance of draws in competition to remove that advantage. Perhaps if it were the old days in which a series could continue as long as it needed, that would be ok, but we already have scheduling conflicts.

(Btw: even allowing draws would not necessarily make the result 50-50. We could be talking about moving the needle by less than 2% advantage to a point that is still slightly unbalanced).
User avatar
HermanHiddema
Gosei
Posts: 2011
Joined: Tue Apr 20, 2010 10:08 am
Rank: Dutch 4D
GD Posts: 645
Universal go server handle: herminator
Location: Groningen, NL
Has thanked: 202 times
Been thanked: 1086 times

Re: Statistically derived komidashi?

Post by HermanHiddema »

shapenaji wrote:Supposing that 7 is, in fact, the correct komi. Would it be worth allowing Jigo again to make the game fairer?


Depends on the circumstances. If would theoretically be fairer, but might have other downsides.

In round-robin leagues it would not have any real downsides.

In Swiss/MacMahon it would work, but introduce slightly more up/down pairings due to the rarity of players with half points.

In knock-out it could break the system (but see: ResolvingJigoByKoThreats)
User avatar
ez4u
Oza
Posts: 2414
Joined: Wed Feb 23, 2011 10:15 pm
Rank: Jp 6 dan
GD Posts: 0
KGS: ez4u
Location: Tokyo, Japan
Has thanked: 2351 times
Been thanked: 1332 times

Re: Statistically derived komidashi?

Post by ez4u »

HermanHiddema wrote:
Matti wrote:I think we also have enough data for 7½ komi. Does some one have them at hand and be able to tell whether black still has an advantage? If yes, then we would need, say 1000 games with 8½ or preferably 9½ to know better.


At http://senseis.xmp.net/?Komi%2FStatistics there is a section I posted about 7.5 or 8.0 (Ing) komi, which has white winning 50.5% of games in a sample of 410 games from gobase.org where both players are at least 8d pro.

I am not sure why you think that 8p both sides is particularly relevant in the present pro environment (consider who gets excluded from the results). Anyway my copy of GoGoD (summer 2013) has 9,340 games with komi of 3.75 (i.e. Chinese rules with 7.5). White wins 52.3%. The not quite 19,000 games with komi of 6.5 have Black winning 50.2%
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21
User avatar
HermanHiddema
Gosei
Posts: 2011
Joined: Tue Apr 20, 2010 10:08 am
Rank: Dutch 4D
GD Posts: 645
Universal go server handle: herminator
Location: Groningen, NL
Has thanked: 202 times
Been thanked: 1086 times

Re: Statistically derived komidashi?

Post by HermanHiddema »

ez4u wrote:I am not sure why you think that 8p both sides is particularly relevant in the present pro environment (consider who gets excluded from the results). Anyway my copy of GoGoD (summer 2013) has 9,340 games with komi of 3.75 (i.e. Chinese rules with 7.5). White wins 52.3%. The not quite 19,000 games with komi of 6.5 have Black winning 50.2%


Is the weaker player (lower pro rank) more likely to get black in that sample? I wanted to avoid that option.
User avatar
shapenaji
Lives in sente
Posts: 1103
Joined: Tue Apr 20, 2010 10:58 pm
Rank: EGF 4d
GD Posts: 952
Location: Netherlands
Has thanked: 407 times
Been thanked: 422 times

Re: Statistically derived komidashi?

Post by shapenaji »

hyperpape wrote:A good question, and I think you can make an argument that draws should be possible in some ideal sense. But if komi suffices to reduce the advantage to less than a 52% win percent (for either White or Black), that's excellent balance. I don't find it worth tolerating a 5% chance of draws in competition to remove that advantage. Perhaps if it were the old days in which a series could continue as long as it needed, that would be ok, but we already have scheduling conflicts.

Chess gets by with far more draws than I think we'd ever have, I feel like competitions could probably handle it.

(Btw: even allowing draws would not necessarily make the result 50-50. We could be talking about moving the needle by less than 2% advantage to a point that is still slightly unbalanced).


Certainly, If the exact 7 pt komi doesn't make the results closer to 50-50, then there's no point. It's just interesting that we have limited our calibration to only adjusting komi by a full point, rather than a half point.
Tactics yes, Tact no...
User avatar
oren
Oza
Posts: 2777
Joined: Sun Apr 18, 2010 5:54 pm
GD Posts: 0
KGS: oren
Tygem: oren740, orenl
IGS: oren
Wbaduk: oren
Location: Seattle, WA
Has thanked: 251 times
Been thanked: 549 times

Re: Statistically derived komidashi?

Post by oren »

shapenaji wrote:Certainly, If the exact 7 pt komi doesn't make the results closer to 50-50, then there's no point. It's just interesting that we have limited our calibration to only adjusting komi by a full point, rather than a half point.


I don't think we'll see that change in professional play. Sponsors and tournament directors want a winner and loser. Having to do repeat games can be a bit annoying.
User avatar
ez4u
Oza
Posts: 2414
Joined: Wed Feb 23, 2011 10:15 pm
Rank: Jp 6 dan
GD Posts: 0
KGS: ez4u
Location: Tokyo, Japan
Has thanked: 2351 times
Been thanked: 1332 times

Re: Statistically derived komidashi?

Post by ez4u »

HermanHiddema wrote:
ez4u wrote:I am not sure why you think that 8p both sides is particularly relevant in the present pro environment (consider who gets excluded from the results). Anyway my copy of GoGoD (summer 2013) has 9,340 games with komi of 3.75 (i.e. Chinese rules with 7.5). White wins 52.3%. The not quite 19,000 games with komi of 6.5 have Black winning 50.2%


Is the weaker player (lower pro rank) more likely to get black in that sample? I wanted to avoid that option.

There are no events like that AFAIK. There are a few special events like the new-shodan games each year in Japan, but they do not use the standard komi.
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21
hyperpape
Tengen
Posts: 4382
Joined: Thu May 06, 2010 3:24 pm
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Location: Caldas da Rainha, Portugal
Has thanked: 499 times
Been thanked: 727 times

Re: Statistically derived komidashi?

Post by hyperpape »

shapenaji wrote:Chess gets by with far more draws than I think we'd ever have, I feel like competitions could probably handle it.
Perhaps you just mean to say that the low proportion of draws in Go would be ok, but comparisons to Chess don't make the point. There is a large and vocal contingent of people complaining about the frequency of draws in high level play, and there have been proposals to change the rules to reduce the number of draws.
lemmata
Lives in gote
Posts: 370
Joined: Thu Feb 23, 2012 12:38 pm
Rank: Weak
GD Posts: 0
Has thanked: 91 times
Been thanked: 254 times

Re: Statistically derived komidashi?

Post by lemmata »

Assume that
  • the players do not resign but always go to counting
  • non-counting draws (due to triple-ko, etc.) do not occur
  • black wants to maximizes black territory minus white territory
  • white wants to maximizes white territory minus black territory
Zermelo/Von Neumann/Morgenstern wrote:Under perfect play, some player (presumably black) always wins by K points with no komi.
Suppose that, as the skill of the players approaches perfection, the probability of black winning by K points approaches 1. Then
  • Under a komi of K+0.5, the probability of white winning by 0.5 approaches 1 as the players approach perfection.
  • Under a komi of K-0.5, the probability of black winning by 0.5 approaches 1 as the players approach perfection.

This seems like an irrelevant mathematical oddity because perfect play is so far off. However, suppose we assume symmetric probabilities (without komi) for Black winning by (K+n) and Black winning by K-n.

Then all we need for White to win 50+x% of the time (with komi=K+0.5) is for the probability of Black winning by K (without komi) to approach 2x%, which is a far cry from 100%. Pros can easily keep any game from getting beyond a 10 point difference with the current komi if they don't care about winning. That actually seems like a conservative estimate if we believe that any top 20 pro could win 90%+ of the time if he was taking black with no komi.

What is the conclusion here? A stable non-integer komi that produces 50-50 outcomes is not a realistic long-term goal. It may be achievable in the short term though.

I could see komi cycling between two values as players research black's fuseki when komi=K+0.5 and research white's fuseki when komi=K-0.5. In the long-run we will either have to keep changing komi every once in a while or switch to a system that allows ties.
lemmata
Lives in gote
Posts: 370
Joined: Thu Feb 23, 2012 12:38 pm
Rank: Weak
GD Posts: 0
Has thanked: 91 times
Been thanked: 254 times

Re: Statistically derived komidashi?

Post by lemmata »

Addendum: The SG Pair Baduk tournament uses a system called "dum betting" (komi betting). Each team secretly writes down a komi value on a piece of paper. The team that wrote down the higher komi value takes black and offers that komi. In the case of a tie, they use nigiri to see who goes first. Such a system, if adopted for one-on-one pro games, may obviate the need to adjust komi values via arduous bureaucratic processes long after the winning percentages get out of hand.
User avatar
shapenaji
Lives in sente
Posts: 1103
Joined: Tue Apr 20, 2010 10:58 pm
Rank: EGF 4d
GD Posts: 952
Location: Netherlands
Has thanked: 407 times
Been thanked: 422 times

Re: Statistically derived komidashi?

Post by shapenaji »

hyperpape wrote:
shapenaji wrote:Chess gets by with far more draws than I think we'd ever have, I feel like competitions could probably handle it.
Perhaps you just mean to say that the low proportion of draws in Go would be ok, but comparisons to Chess don't make the point. There is a large and vocal contingent of people complaining about the frequency of draws in high level play, and there have been proposals to change the rules to reduce the number of draws.


Well, they certainly argue about the frequency of draws, but not their existence. I think most chess players are fine with the possibility of draws, they just don't like that top players have methods at their disposal to ensure draw-like games. I don't think go lends itself to a drawing strategy in the same way.
Tactics yes, Tact no...
Bill Spight
Honinbo
Posts: 10905
Joined: Wed Apr 21, 2010 1:24 pm
Has thanked: 3651 times
Been thanked: 3373 times

Re: Statistically derived komidashi?

Post by Bill Spight »

shapenaji wrote:
hyperpape wrote:
shapenaji wrote:Chess gets by with far more draws than I think we'd ever have, I feel like competitions could probably handle it.
Perhaps you just mean to say that the low proportion of draws in Go would be ok, but comparisons to Chess don't make the point. There is a large and vocal contingent of people complaining about the frequency of draws in high level play, and there have been proposals to change the rules to reduce the number of draws.


Well, they certainly argue about the frequency of draws, but not their existence. I think most chess players are fine with the possibility of draws, they just don't like that top players have methods at their disposal to ensure draw-like games. I don't think go lends itself to a drawing strategy in the same way.


Wasn't there a flap several years ago about an arranged draw (or no result) in a go tournament?
The Adkins Principle:
At some point, doesn't thinking have to go on?
— Winona Adkins

Visualize whirled peas.

Everything with love. Stay safe.
User avatar
shapenaji
Lives in sente
Posts: 1103
Joined: Tue Apr 20, 2010 10:58 pm
Rank: EGF 4d
GD Posts: 952
Location: Netherlands
Has thanked: 407 times
Been thanked: 422 times

Re: Statistically derived komidashi?

Post by shapenaji »

Bill Spight wrote:
Wasn't there a flap several years ago about an arranged draw (or no result) in a go tournament?


Have a handy link?

I think that's the big difference though, in chess it doesn't take collusion to force a draw with high probability (as white).
Tactics yes, Tact no...
SmoothOper
Lives in sente
Posts: 946
Joined: Thu Apr 19, 2012 9:38 am
Rank: IGS 5kyu
GD Posts: 0
KGS: KoDream
IGS: SmoothOper
Has thanked: 1 time
Been thanked: 41 times

Re: Statistically derived komidashi?

Post by SmoothOper »

shapenaji wrote:
hyperpape wrote:
shapenaji wrote:Chess gets by with far more draws than I think we'd ever have, I feel like competitions could probably handle it.
Perhaps you just mean to say that the low proportion of draws in Go would be ok, but comparisons to Chess don't make the point. There is a large and vocal contingent of people complaining about the frequency of draws in high level play, and there have been proposals to change the rules to reduce the number of draws.


Well, they certainly argue about the frequency of draws, but not their existence. I think most chess players are fine with the possibility of draws, they just don't like that top players have methods at their disposal to ensure draw-like games. I don't think go lends itself to a drawing strategy in the same way.


I think the rules in chess encourage draws, by allowing repeated states, though it is difficult to keep track of the repeated states in casual settings since chess has so many configurations with the same set of pieces, however if they had a super ko type rule, they wouldn't have this problem.
Post Reply