
DeepMind give AlphaGo strength graph, and it will shock you!
-
RobertJasiek
- Judan
- Posts: 6273
- Joined: Tue Apr 27, 2010 8:54 pm
- GD Posts: 0
- Been thanked: 797 times
- Contact:
Re: DeepMind give AlphaGo strength graph, and it will shock
They continue the same mistake of setting amateur 9d below professional 1p. If AlphaGo v.18 were much stronger than human 9p, it would not have lost any game against Lee Sedol.
-
pookpooi
- Lives in sente
- Posts: 727
- Joined: Sat Aug 21, 2010 12:26 pm
- GD Posts: 10
- Has thanked: 44 times
- Been thanked: 218 times
Re: DeepMind give AlphaGo strength graph, and it will shock
RobertJasiek wrote:They continue the same mistake of setting amateur 9d below professional 1p. If AlphaGo v.18 were much stronger than human 9p, it would not have lost any game against Lee Sedol.
Agree, this is my version of the graph, I don't claim it's 100% accurate though cause professional dan work in different way than kyu - amateur dan.

-
Uberdude
- Judan
- Posts: 6727
- Joined: Thu Nov 24, 2011 11:35 am
- Rank: UK 4 dan
- GD Posts: 0
- KGS: Uberdude 4d
- OGS: Uberdude 7d
- Location: Cambridge, UK
- Has thanked: 436 times
- Been thanked: 3718 times
Re: DeepMind give AlphaGo strength graph, and it will shock
Gosh, beating Nature/Fan Hui AlphaGo with 4 stones is impressive, but I reserve my judgement about the meaning of that in actual strength given bots may have trouble playing with/against handicap. A better test would be could/did it give 4 stones to Fan Hui? If AlphaGo v18 were 4000 Elo and Lee Sedol 3500 then it should win a single game 95% of the time and the match 5-0 with 78% chance so it doesn't look 4000 let alone 4500. Having said that it only lost game 4 due to one move far below the usual high standard of its moves (and subsequent monte carlo nonsense which can sort of be dismissed, though not entirely as the ability to play sensibly and well when behind is important, though perhaps not so much if AlphaGo fixes that bug and is then never behind in any game against a human ever!) so if they could fix that bug/blunder/weakness then such high Elos might be plausible. However, I expect humans to improve how they do against AlphaGo with practice if Deepmind make it more widely available, though of course AlphaGo will also likely keep improving. We can already see than in just 5 games Lee Sedol was able to learn and adapt how to play against AlphaGo with some success, whilst AlphaGo v13 needed 60 million positions and games to get to its level (plus scores of clever developers/researchers) and AlphaGo v18 probably used far more, so humans are still pretty good at this learning thing.
P.S. ajahuang was on KGS yesterday testing the gtp interface for an AlphaGoBot to play on KGS, subject to Google's permission. Said it would likely first play in some arranged matches against some pros / 9ds before (if) being more widely available. Exciting!
P.S. ajahuang was on KGS yesterday testing the gtp interface for an AlphaGoBot to play on KGS, subject to Google's permission. Said it would likely first play in some arranged matches against some pros / 9ds before (if) being more widely available. Exciting!
-
pookpooi
- Lives in sente
- Posts: 727
- Joined: Sat Aug 21, 2010 12:26 pm
- GD Posts: 10
- Has thanked: 44 times
- Been thanked: 218 times
Re: DeepMind give AlphaGo strength graph, and it will shock
Uberdude wrote:P.S. ajahuang was on KGS yesterday testing the gtp interface for an AlphaGoBot to play on KGS, subject to Google's permission. Said it would likely first play in some arranged matches against some pros / 9ds before (if) being more widely available. Exciting!
I was also there, very exciting time even it's a false positive
-
uPWarrior
- Lives with ko
- Posts: 199
- Joined: Mon Jan 17, 2011 1:59 pm
- Rank: KGS 3 kyu
- GD Posts: 0
- Has thanked: 6 times
- Been thanked: 55 times
Re: DeepMind give AlphaGo strength graph, and it will shock
I think that graph is believable is you treat "9d" as "average 9d". In that case, Lee Sedol himself would not be 3500 but probably 3800+.
Remember that these scales are arbitrary anyway.
Remember that these scales are arbitrary anyway.
-
yoyoma
- Lives in gote
- Posts: 653
- Joined: Mon Apr 19, 2010 8:45 pm
- GD Posts: 0
- Location: Austin, Texas, USA
- Has thanked: 54 times
- Been thanked: 213 times
Re: DeepMind give AlphaGo strength graph, and it will shock
Well I can certainly see why they were "quietly confident" going into the Lee Sedol match!
BTW it played 7 games on Tygem today and won all 7.
BTW it played 7 games on Tygem today and won all 7.
-
Krama
- Lives in gote
- Posts: 436
- Joined: Mon Jan 06, 2014 3:46 am
- Rank: KGS 5 kyu
- GD Posts: 0
- Has thanked: 1 time
- Been thanked: 38 times
Re: DeepMind give AlphaGo strength graph, and it will shock
yoyoma wrote:Well I can certainly see why they were "quietly confident" going into the Lee Sedol match!
BTW it played 7 games on Tygem today and won all 7.
What nickname is it on tygem?
The "deepmind" account actually has something like 40 wins 20 loses.
-
yoyoma
- Lives in gote
- Posts: 653
- Joined: Mon Apr 19, 2010 8:45 pm
- GD Posts: 0
- Location: Austin, Texas, USA
- Has thanked: 54 times
- Been thanked: 213 times
Re: DeepMind give AlphaGo strength graph, and it will shock
Krama wrote:yoyoma wrote:Well I can certainly see why they were "quietly confident" going into the Lee Sedol match!
BTW it played 7 games on Tygem today and won all 7.
What nickname is it on tygem?
The "deepmind" account actually has something like 40 wins 20 loses.
Yes the deepmind account. I just meant it's most recent 7 games.
-
Krama
- Lives in gote
- Posts: 436
- Joined: Mon Jan 06, 2014 3:46 am
- Rank: KGS 5 kyu
- GD Posts: 0
- Has thanked: 1 time
- Been thanked: 38 times
Re: DeepMind give AlphaGo strength graph, and it will shock
yoyoma wrote:Krama wrote:yoyoma wrote:Well I can certainly see why they were "quietly confident" going into the Lee Sedol match!
BTW it played 7 games on Tygem today and won all 7.
What nickname is it on tygem?
The "deepmind" account actually has something like 40 wins 20 loses.
Yes the deepmind account. I just meant it's most recent 7 games.
But in last 7 games it won 2 and lost 5 or was it won 3 lost 4
-
yoyoma
- Lives in gote
- Posts: 653
- Joined: Mon Apr 19, 2010 8:45 pm
- GD Posts: 0
- Location: Austin, Texas, USA
- Has thanked: 54 times
- Been thanked: 213 times
Re: DeepMind give AlphaGo strength graph, and it will shock
I'm at work now so I can't check with the client, I'm going off this reddit post https://www.reddit.com/r/baduk/comments ... ns_so_far/ which has this image linked: http://postimg.org/image/rvxwwof93/
There is has seven red circles in a row at the end, and below you can see those games played on March 25.
There is has seven red circles in a row at the end, and below you can see those games played on March 25.
-
sorin
- Lives in gote
- Posts: 389
- Joined: Wed Apr 21, 2010 9:14 pm
- Has thanked: 418 times
- Been thanked: 198 times
Re: DeepMind give AlphaGo strength graph, and it will shock
yoyoma wrote:I'm at work now so I can't check with the client, I'm going off this reddit post https://www.reddit.com/r/baduk/comments ... ns_so_far/ which has this image linked: http://postimg.org/image/rvxwwof93/
There is has seven red circles in a row at the end, and below you can see those games played on March 25.
Given that Aja Huang said he didn't get Google approval to play on KGS yet, I doubt that the deepmind account on Tygem is AlphaGo, at least it won't be the latest version.
Why would they give approval for Tygem, but not for KGS?
Sorin - 361points.com
-
Kirby
- Honinbo
- Posts: 9553
- Joined: Wed Feb 24, 2010 6:04 pm
- GD Posts: 0
- KGS: Kirby
- Tygem: 커비라고해
- Has thanked: 1583 times
- Been thanked: 1707 times
Re: DeepMind give AlphaGo strength graph, and it will shock
sorin wrote:Given that Aja Huang said he didn't get Google approval to play on KGS yet, I doubt that the deepmind account on Tygem is AlphaGo, at least it won't be the latest version.
Why would they give approval for Tygem, but not for KGS?
Didn't Aja Huang also say that 'deepmind' on Tygem was his account [1]? Is it possible that 'deepmind' on Tygem is not "pure AlphaGo", but rather Aja Huang + AlphaGo - maybe experimenting a bit, or just playing around?
Just a theory, but it could explain things.
---
[1] https://www.reddit.com/r/baduk/comments ... _on_tygem/
KillerDucky wrote:It's Aja Huang. He said so himself in the youtube stream, and denied that AlphaGo played on the account.
be immersed
-
yoyoma
- Lives in gote
- Posts: 653
- Joined: Mon Apr 19, 2010 8:45 pm
- GD Posts: 0
- Location: Austin, Texas, USA
- Has thanked: 54 times
- Been thanked: 213 times
Re: DeepMind give AlphaGo strength graph, and it will shock
They aren't exactly straightforward about it. Yes earlier Aja Hwang had said that deepmind was his own personal account. But later there was a Korean article with a picture of Demis Hassibis and the CEO of Tygem. The title was something like "Thanks Tygem!". Even in that article it's sorta like Demis is saying it's Aja's account, but he sorta "indirectly" confirmed it. It's like they are saying it's Aja's personal account, but they are no longer directly denying that he used it for AlphaGo anymore.
I want to be careful about this too but at this point is just seems overwhelmingly likely that AlphaGo is playing on that account, just for some reason Deepmind just doesn't want to publicize this. That's my take at least.
I want to be careful about this too but at this point is just seems overwhelmingly likely that AlphaGo is playing on that account, just for some reason Deepmind just doesn't want to publicize this. That's my take at least.
-
Kirby
- Honinbo
- Posts: 9553
- Joined: Wed Feb 24, 2010 6:04 pm
- GD Posts: 0
- KGS: Kirby
- Tygem: 커비라고해
- Has thanked: 1583 times
- Been thanked: 1707 times