On my way to shodan and need reviews game#2

Post your games here for other members to critique your play.
User avatar
prokofiev
Lives with ko
Posts: 223
Joined: Tue Apr 27, 2010 8:03 pm
Rank: decent sdk
GD Posts: 138
Has thanked: 67 times
Been thanked: 10 times

Re: On my way to shodan and need reviews game#2

Post by prokofiev »

daniel_the_smith wrote:Given all the above, I think some of you are blaspheming the holy name of Bayes.


Oh dear. So as not to clog up the thread more, I'll hide my response.

daniel_the_smith wrote:You're saying, if I read correctly, "Given that I experienced a loss, Bayes says we should expect my mistakes must have been bigger". In isolation, yes. But you're not done, you also have to run some other hypotheses through, like the one that "my mistakes must have been more numerous", and the one that, "my opponent's mistakes were fewer and/or less severe". You can't use Bayes unless your evidence distinguishes between those hypotheses, i.e., it has to actually be evidence. Without knowing the player's mistake frequency and size distributions, I don't think the fact that there was a loss favors any of those explanations.


Here's what I had in mind. Let L be the event of a game loss. Let M be the event of one particular type of significant mistake for the player in question (an example of a particular type of mistake would be "missing a snapback"; another would be "needlessly allowing a group to be enclosed").

Now what I want you to allow me is that P(L|M) > P(L|not M), i.e. the probability you lose if you make that type of mistake in your game is larger than the probability you lose if you don't make the mistake. (No Bayes Theorem yet.) If you don't allow me this, so be it, but keep reading for where I would have used Bayes Theorem if you had.

If so, then some algebraic manipulation using Bayes Theorem (i.e. P(A|B)P(B) = P(B|A)P(A)) allows me to conclude P(M|L) > P(M|not L), i.e. the probability you make that type of mistake in a lost game is larger than the probability you make that mistake in a won game. I'll leave out the algebraic manipulation unless this last bit is really what you're challenging.

If this counts as meaningless, sorry! :-?
User avatar
daniel_the_smith
Gosei
Posts: 2116
Joined: Wed Apr 21, 2010 8:51 am
Rank: 2d AGA
GD Posts: 1193
KGS: lavalamp
Tygem: imapenguin
IGS: lavalamp
OGS: daniel_the_smith
Location: Silicon Valley
Has thanked: 152 times
Been thanked: 330 times
Contact:

Re: On my way to shodan and need reviews game#2

Post by daniel_the_smith »

prokofiev wrote:Here's what I had in mind. Let L be the event of a game loss. Let M be the event of one particular type of significant mistake for the player in question (an example of a particular type of mistake would be "missing a snapback"; another would be "needlessly allowing a group to be enclosed").

Now what I want you to allow me is that P(L|M) > P(L|not M), i.e. the probability you lose if you make that type of mistake in your game is larger than the probability you lose if you don't make the mistake.


I'll totally grant that. But M is actually a class of hypotheses. So M1 is playing a bad forcing move, M2 is losing sente, etc., up to MN is running out of time.

prokofiev wrote:If so, then some algebraic manipulation using Bayes Theorem (i.e. P(A|B)P(B) = P(B|A)P(A)) allows me to conclude P(M|L) > P(M|not L), i.e. the probability you make that type of mistake in a lost game is larger than the probability you make that mistake in a won game. I'll leave out the algebraic manipulation unless this last bit is really what you're challenging.


This is true but only half the story. The thing is, that logic doesn't distinguish between various classes of mistake. Yes, it means M1 is more likely, but it also means M2 is the same amount more likely. It also raises P(OW) (where OW = Opponent played well) by the same amount. Just knowing that you lost raises the probability of all potential causes of your loss, including ones that have nothing to do with you. To make the particular conclusion you're trying to make, you need evidence that would look different depending on what exactly caused your loss.

To put it differently, you need evidence that changes the relative frequency of the possible explanations.

Suppose M5 is missing a snapback and M6 is self atari. If you're normal, you probably miss more snapbacks than self-ataris, so the prior for M5 is larger than the prior of M6. If M5 was 10% more likely than M6 to begin with, it will still be 10% more likely after observing a loss and applying Bayes. Even though the probability of both M5 and M6 will have gone up, their relative frequency didn't change.

To get to your conclusion, you'd have to have evidence to the effect that larger mistakes result in losses more often than more numerous small mistakes. Then you can plug actual numbers into Bayes and watch it change the relative frequencies of the hypotheses.

I'm hungry so hopefully that makes sense :)
That which can be destroyed by the truth should be.
--
My (sadly neglected, but not forgotten) project: http://dailyjoseki.com
hyperpape
Tengen
Posts: 4382
Joined: Thu May 06, 2010 3:24 pm
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Location: Caldas da Rainha, Portugal
Has thanked: 499 times
Been thanked: 727 times

Re: On my way to shodan and need reviews game#2

Post by hyperpape »

Daniel, why are you so concerned about biggest mistakes? I realize someone may have said something about "biggest mistakes" but what we're really worried about is the mistakes that have the highest "weighted measure"* of bigness and frequency. And isn't the Bayesian argument just transparent there?

If I have a 120 point mistake that happens one in one hundred games, that sucks, and I'd like it fixed, but I'll still care more about a 2 point mistake that happens in half my games.

* That's a weasel phrase. I don't mean anything technical.
User avatar
daniel_the_smith
Gosei
Posts: 2116
Joined: Wed Apr 21, 2010 8:51 am
Rank: 2d AGA
GD Posts: 1193
KGS: lavalamp
Tygem: imapenguin
IGS: lavalamp
OGS: daniel_the_smith
Location: Silicon Valley
Has thanked: 152 times
Been thanked: 330 times
Contact:

Re: On my way to shodan and need reviews game#2

Post by daniel_the_smith »

hyperpape wrote:Daniel, why are you so concerned about biggest mistakes? I realize someone may have said something about "biggest mistakes" but what we're really worried about is the mistakes that have the highest "weighted measure"* of bigness and frequency. And isn't the Bayesian argument just transparent there?


Depending on how you define "weighted measure" (which I think is a useful concept, and maybe one we should attempt to define), I think that becomes a tautology, no need for Bayes at all.

For example, if the WM of a particular mistake is the percentage of lost games it appears in, then this is a tautology. :)

hyperpape wrote:If I have a 120 point mistake that happens one in one hundred games, that sucks, and I'd like it fixed, but I'll still care more about a 2 point mistake that happens in half my games.

Yeah, totally.
That which can be destroyed by the truth should be.
--
My (sadly neglected, but not forgotten) project: http://dailyjoseki.com
User avatar
jts
Oza
Posts: 2662
Joined: Sat Sep 18, 2010 4:17 pm
Rank: kgs 6k
GD Posts: 0
Has thanked: 310 times
Been thanked: 632 times

Re: On my way to shodan and need reviews game#2

Post by jts »

I don't see any particular reason to continue the discussion (and promised myself I wouldn't! :) ). Ed and I each had our say, I doubt Round 3 would be any more profitable than Round 2. But for the developing argument about Bayes' Theorem, it's worth distinguishing between my highly focused point, which I think is influencing Daniel, and a broader point, which prokofiev and hyperpape were elaborating with Bayes' Theorem.

Broad point: if you randomly select one of your won games and one of your lost games, ex ante it's more likely that the lost game will have an example of any particular error you make. On inspection there may be more of a particular class of error, large or small, in the won game, but but ex ante you wouldn't suspect this, would you? Relative proportions don't matter.

Focused point: Perfect play gains nothing, so saying that a move loses X points already assumes that the opponent will respond correctly. Errors that are part of larger sequences where the opponent screws up or doesn't notice the mistake don't affect the point total, and so don't affect who wins. To use our formal terminology, something like {bad ko threat & opponent ignores} is a mistake class that loses points and is more likely to show up in a lost game, while {bad ko threat & opponent answers} actually gains points and so is no more likely to show up in a lost game, even though the bad ko threat was an equally large mistake in either case. Similar examples: {capture in ladder instead of net & opponent plays ladder breaker}, {mess up l&d & opponent kills}, {make weak group & opponent attacks}. All of these mistakes are equally bad regardless of what the opponent does, but in some of them telling the player what the correct play is is much easier than getting him to appreciate how bad things could have gotten if his opponent had responded correctly.

I was calling these "big mistakes" in a colloquial way, but if we want feed them into a probability function we would have to specify that it is the opponent's lack of mistakes in responding to them that is making my original, point-losing move both (i) "bigger," and so more likely to be found in a lost game, and (ii) "glaring," and so easier to learn from.

Back to the broad point: here's a heuristic argument that may show that large errors are relatively more likely in lost games. I haven't actually formalized it, so it may be garbage. Let's say I play an opponent, always taking black, hundreds of times, and we randomly vary the komi between zero, 7, and 14 in each game. Using 14 komi is like making a 14 point mistake on the first move, 7 komi is like me making a 7 point mistake. If we're even with no komi, perhaps he wins 70% of the games with 7 komi and 90% of the games with 14 komi. So while I make this particular 7 pt. mistake with pr=.33 and the 14 pt. mistake with pr=.33, the pr(14 komi game | i lost)= .43, while pr(7 komi game | i lost) = .33. I don't think this relies on the fact that pr(14 komi |7 komi)=0. So the relative frequency of large mistakes should be higher in lost games.

But I'm not trying to say that I think errors of large magnitude are necessarily more important, and this doesn't affect any argument about which games to review.. My point was always narrowly about how palpable the consequences of the error are, which depends on independent events later in the game. In fact, I think that one thing prokofiev has shown is that a lost game is much more likely to contain multiple cases of the same error, which would make it much easier to correct common small errors in lost game. (Again, this goes back to making things manifest: when you can point out that someone made the same endgame mistake four times, he'll understand why the game suddenly turned against him, and won't do it again.)
User avatar
prokofiev
Lives with ko
Posts: 223
Joined: Tue Apr 27, 2010 8:03 pm
Rank: decent sdk
GD Posts: 138
Has thanked: 67 times
Been thanked: 10 times

Re: On my way to shodan and need reviews game#2

Post by prokofiev »

daniel_the_smith wrote:This is true but only half the story. The thing is, that logic doesn't distinguish between various classes of mistake. Yes, it means M1 is more likely, but it also means M2 is the same amount more likely. It also raises P(OW) (where OW = Opponent played well) by the same amount. Just knowing that you lost raises the probability of all potential causes of your loss, including ones that have nothing to do with you. To make the particular conclusion you're trying to make, you need evidence that would look different depending on what exactly caused your loss.

To put it differently, you need evidence that changes the relative frequency of the possible explanations.

Suppose M5 is missing a snapback and M6 is self atari. If you're normal, you probably miss more snapbacks than self-ataris, so the prior for M5 is larger than the prior of M6. If M5 was 10% more likely than M6 to begin with, it will still be 10% more likely after observing a loss and applying Bayes. Even though the probability of both M5 and M6 will have gone up, their relative frequency didn't change.

To get to your conclusion, you'd have to have evidence to the effect that larger mistakes result in losses more often than more numerous small mistakes. Then you can plug actual numbers into Bayes and watch it change the relative frequencies of the hypotheses.

I'm hungry so hopefully that makes sense :)


I'm not sure what my conclusion was supposed to be. If you want something not specific to a particular type of mistake, how about this:

Call a type of mistake M for which you'll allow P(L|M) > P(L|not M) a "relevant" type of mistake. Then the conclusion I had for each type of mistake individually, i.e. P(M|L) > P(M| not L) for "relevant" M, implies that the expected number of "relevant" *types* of mistakes in a lost game is higher than the expected number of "relevant types of mistakes in a won game. (No mention of frequency of mistake within a given type.)

The expected number of "relevant" types of mistakes present seems a reasonable measure of what sort of game is good to review.

An aside: There are presumably types of mistakes that are not "relevant" in the above sense. I imagine that certain endgame errors are much more likely in won games than in lost games, at least for some individuals.
User avatar
daniel_the_smith
Gosei
Posts: 2116
Joined: Wed Apr 21, 2010 8:51 am
Rank: 2d AGA
GD Posts: 1193
KGS: lavalamp
Tygem: imapenguin
IGS: lavalamp
OGS: daniel_the_smith
Location: Silicon Valley
Has thanked: 152 times
Been thanked: 330 times
Contact:

Re: On my way to shodan and need reviews game#2

Post by daniel_the_smith »

I really want to go further down the rabbit hole, but I'm rushing to get some stuff done before I drive to a go tournament tomorrow. Maybe I'll remember to respond later :)
That which can be destroyed by the truth should be.
--
My (sadly neglected, but not forgotten) project: http://dailyjoseki.com
Leyleth
Dies in gote
Posts: 66
Joined: Tue Nov 22, 2011 8:00 am
Rank: KGS 3k
GD Posts: 0
KGS: Schnapps
Has thanked: 1 time
Been thanked: 6 times

Re: On my way to shodan and need reviews game#2

Post by Leyleth »

Whoooow! I don't go on the forums for a little while due to school and a debate comes, with people talking all over the place :D

First of all, let me explain why I only post games that I have won. Mostly, it is due to my lack of defeats on kgs (4 defeats in my last 20 games). In these 4 defeats, in 3 of them, I understood why I had lost very easily. No need to review them. The other one has been reviewed right after by a 6d member (won the second place of an amateur tournament in France recently) of my go club as well as many dan players. I didn't saw the need of posting it and get more reviews. Pretty much everything has been discussed.

Secondly, I post my won games because they show how I can play. Some of them (and the ones I post) are closer to my level when I play "real life" go.

Finally, I often experiment, trying some moves that "seem" good, but that I saw nowhere yet. I want to see if they work.

I don't think that posting only wins or only losses influences something. After all, in a lost game, you'll understand why you lost. However, in a won game, you'll understand why your opponent could have came back and flew away with the victory. Both of these elements are important, in my opinion.

So, to conclude all this, let me post another won game, just to bug the people that want to see some lost games. This one was against a 6k with 0,5 komi. However, the difference in the komi made no difference whatsoever in the result.



There's a nasty little fight at move 169. I reviewed this quickly with some kyu players, but dan advice would be awesome.
Post Reply