It is currently Thu Mar 28, 2024 3:11 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 52 posts ]  Go to page 1, 2, 3  Next
Author Message
Offline
 Post subject: Humans vs. Alpha Go Zero
Post #1 Posted: Thu Mar 18, 2021 9:46 pm 
Lives in gote

Posts: 676
Liked others: 6
Was liked: 31
KGS: 2d
Since AGZ (or put any other AI into) does not play thru Brute-Force, it also means that it is imperfect. So we should be able to beat it due to plain statistics by playing e.g. 1.000 pro's against it we should be able to get 1-2 wins at least. What do you think? Wouldn't that be a cool project? (Could this project be also made in Chess where the situation is quite the same?)

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #2 Posted: Fri Mar 19, 2021 1:53 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
of course not! it's like if all people throw a ball at the moon and one ball will hit! :)


This post by And was liked by 2 people: Harleqin, jmeinh
Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #3 Posted: Fri Mar 19, 2021 4:57 am 
Lives in gote

Posts: 532
Liked others: 1
Was liked: 136
Rank: 13k
Michael Redmond 9P and Chris Garlock AGA analyze a long series of pro v A games on the YouTubes. Doesn't seem to be any chance a highly skilled player beating the machine. Ever.

When pros work together, does their go appear to be played better than any pro alone or does it, as in many cooperative creative endeavors where conflicting priorities and styles can neither be easily nor quickly resolved, actually add up to what might present on the board as the product of less than one?

_________________
David Bogie, Boise ID
I play go, I ride a recumbent, of course I use Macintosh.

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #4 Posted: Fri Mar 19, 2021 12:15 pm 
Lives in gote

Posts: 676
Liked others: 6
Was liked: 31
KGS: 2d
And wrote:
of course not! it's like if all people throw a ball at the moon and one ball will hit! :)


This is different because the winning probability would be 0.0. But in Go we always have winning probabilities below 1 and above 0 (for quite some parts of the game) which means by the law of large numbers that if you can summon enough Go players it should lead to some defeats of the AI machines. In fact I'd believe that if you summom 1.000 pros you'd beat AGZ 1-2 times. Don't u think?

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #5 Posted: Fri Mar 19, 2021 12:53 pm 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
calculate the probability if:
AlphaGo Lee 4:1 against Lee Sedol
AlphaGo Master 60:0 against professional players
AlphaGo Zero 100:0 against AlphaGo Lee
AlphaGo Zero 89:11 against AlphaGo Master
https://en.wikipedia.org/wiki/AlphaGo_Zero

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #6 Posted: Fri Mar 19, 2021 1:05 pm 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
A former world champion of the game Go says he's retiring because AI is so strong: 'Even if I become the No. 1, there is an entity that cannot be defeated'
https://www.businessinsider.com/deep-mi ... ?r=US&IR=T

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #7 Posted: Fri Mar 19, 2021 1:27 pm 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
if all the pros play all the time, they will never win

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #8 Posted: Fri Mar 19, 2021 6:32 pm 
Oza
User avatar

Posts: 2401
Location: Tokyo, Japan
Liked others: 2338
Was liked: 1332
Rank: Jp 6 dan
KGS: ez4u
Pippen wrote:
And wrote:
of course not! it's like if all people throw a ball at the moon and one ball will hit! :)


This is different because the winning probability would be 0.0. But in Go we always have winning probabilities below 1 and above 0 (for quite some parts of the game) which means by the law of large numbers that if you can summon enough Go players it should lead to some defeats of the AI machines. In fact I'd believe that if you summom 1.000 pros you'd beat AGZ 1-2 times. Don't u think?

If you were correct, why would that be interesting? :scratch:

_________________
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #9 Posted: Sat Mar 20, 2021 12:17 pm 
Dies in gote

Posts: 51
Liked others: 7
Was liked: 1
Rank: KGS 10 kyu
KGS: SinKing
OGS: J__P__
bogiesan wrote:
Michael Redmond 9P and Chris Garlock AGA analyze a long series of pro v A games on the YouTubes. Doesn't seem to be any chance a highly skilled player beating the machine. Ever.


You have a link to these videos? They sound pretty cool!


Last edited by WriterJon on Sat Mar 20, 2021 1:36 pm, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #10 Posted: Sat Mar 20, 2021 12:24 pm 
Lives in gote

Posts: 476
Location: Netherlands
Liked others: 270
Was liked: 147
Rank: EGF 3d
Universal go server handle: gennan
Deepmind's reported Elo ratings for different AlphaGo versions seems to be fairly compatible with the pro Elo ratings reported at https://www.goratings.org/en/.

So we may estimate the Elo difference between AGZ (5200 Elo) and Shin JinSeo (3800 Elo) to be about 1400 Elo. That would mean Shin JinSeo has about 0.03% probability to win. So if you clone him into an army of Shin Jinseos, that army would need to play about 3000 games against AGZ to win 1 game.

If cloning is not allowed and you have to settle for "average" pros with an Elo ratings in the range 2800-3200, the pro army would be about 2400-2000 Elo weaker than AGZ. Such pros would have winning probabilities ranging from 0.0001% to 0.001%. So that "average" pro army would need to play 100,000 - 1,000,000 games against AGZ to win 1 game.


Last edited by gennan on Sat Mar 20, 2021 1:22 pm, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #11 Posted: Sat Mar 20, 2021 12:59 pm 
Lives in sente

Posts: 757
Liked others: 114
Was liked: 916
Rank: maybe 2d
I know gennan and many regulars are aware of this, but for casual forum-browsers who haven't seen other posts on it: Usually whenever you talk about anything like 1000 Elo or more corresponding to winning chances, all conclusions you make are pure extrapolation and there little or no evidence on whether it is accurate. It's close to just pulling guesses out of a hat for fun. Which can be still fun. :)

The Elo model is a simplistic model - the idea that you can take ratings differences between successive different players, simply add them up, and that will give you a guess of the winning chance between players you've never actually played before. Or equivalently, that you just multiply the odds. There's no reason why such a model has to work, and the real world is under no obligation to behave like this. It's the other way around - you calibrate the model until it produces not terribly-unreasonable answers for moderate differences, like up to maybe as much as 400 or 600 Elo, and it's anybody's guess outside the situations you calibrated your model for.

If A is, for example, 1600 Elo weaker than E in rating system, we're just joking and having fun to say that corresponds to some winning odds like 1:10000. In reality what it means is closer much closer something like: we think A has 1:10 odds against B, who we think has 1:10 odds against C, who we think has 1:10 odds against D who we think has 1:10 odds against E. Whether that actually means you can just multiply the odds, and say A has 1:(10 * 10 * 10 * 10) odds against E in some game and have that be remotely accurate - usually nobody has any evidence for that.


This post by lightvector was liked by 3 people: ez4u, gennan, Harleqin
Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #12 Posted: Sat Mar 20, 2021 1:25 pm 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
when there is such a difference in strength, it might not be enough to just count the probability? go game is not roulette

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #13 Posted: Sat Mar 20, 2021 1:44 pm 
Lives in gote

Posts: 476
Location: Netherlands
Liked others: 270
Was liked: 147
Rank: EGF 3d
Universal go server handle: gennan
Lightvector is right ofcourse. It's hard to accurately measure large skill gaps by even game win% and the results may not even be very meaningful.

But I think go has a nice feature to measure large skill gaps: Determine the handicap needed to achieve about 50% winrate. One can use handicap stones and/or komi handicap for that.

There are some special addition rules for handicap, like: player A needs 2 stones against player B (3 half ranks difference), who needs 2 stones against player C, who needs 2 stones against player D, so player A needs 5 stones against player D (9 half ranks difference). In practice, this handicap system seems to hold up fairly well to measure skill gaps that would translate to quite large Elo gaps.

This method has been used to measure the skill gap between pros and AI, though only in casual games. From the casual games that I saw, it looks like pros usually need 3 stones handicap against a good AI.


This post by gennan was liked by 2 people: hyperpape, lightvector
Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #14 Posted: Sun Mar 21, 2021 6:04 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
@gennan
Let's suppose, in theory, that you are playing against 5 kyu, playing at full strength every game. do you agree that he will never win? but if you calculate the probability, it is not equal to 0. If you are not sure about 5 kyu, then 10 kyu

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #15 Posted: Sun Mar 21, 2021 8:29 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
Is it always if network A is stronger than network B, and network B is stronger than network C, then network A is stronger than network C?

The paradox of transitivity
Szekely G.J. "Paradoxes in Probability Theory and Mathematical Statistics"

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #16 Posted: Sun Mar 21, 2021 1:43 pm 
Lives in gote

Posts: 476
Location: Netherlands
Liked others: 270
Was liked: 147
Rank: EGF 3d
Universal go server handle: gennan
And wrote:
@gennan
Let's suppose, in theory, that you are playing against 5 kyu, playing at full strength every game. do you agree that he will never win? but if you calculate the probability, it is not equal to 0. If you are not sure about 5 kyu, then 10 kyu

From my own Elo to EGF rank conversion estimate, I estimate the gap between me and a typical 5k to be about 600 Elo, which would imply a win% of about 5% for them (1 in 20 games).
And I would estimate the gap between me and a typical 10k to be about 900 Elo, which would imply a win% of about 0.5% for them (1 in 200 games).
I don't know if those estimates are realistic, but I don't intend to play very long matches against 5k and 10k players to accurately determine their winning probability.

I did lose an online game last December against a player with an OGS rating hovering around (2021) OGS 3k. And in the past 25 years I have lost several tournament games against 1k players. I just looked up my score against 1k in the EGD and it is 25-7, so 1k has about 20% winrate against me (suggesting a 250 Elo gap, though it might be a bit biased, because I usually only play against 1k in tournaments when they have a good day and I have a bad day).

I think there is always some probability that my opponent wins, no matter how weak they are. Yes, at some point the probability becomes less than 1%, but it's never going to be 0.
For example, I could get a stroke during the game. I don't know the exact odds for such a thing happening, but I think it's at least something like 1 in 1,000,000 games.
That probability is small, but clearly bigger than your example of throwing balls at the moon, because it's physically impossible for even the strongest humans to throw a ball with a velocity close to escape velocity (11.2 km/s) and then I'm even ignoring drag from the atmosphere.


Last edited by gennan on Sun Mar 21, 2021 2:20 pm, edited 3 times in total.
Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #17 Posted: Sun Mar 21, 2021 1:50 pm 
Gosei

Posts: 1625
Liked others: 542
Was liked: 450
Rank: senior player
GD Posts: 1000
We are familiar with the humerous idea that if a monkey were randomly typing on typewriter eventually the works of Shakespeare would come out with probability 1. By this reasoning even random play could eventually win a go game against alphago. Of course "eventually" would likely mean longer than the existence of the universe. In practice I would think that machines 10 time stronger would be developed every so often so that eventually Alphago will seem to be ridiculously weak ;)

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #18 Posted: Sun Mar 21, 2021 1:54 pm 
Gosei
User avatar

Posts: 1753
Liked others: 177
Was liked: 491
I know a 1d who self-ataried and lost a tournament game against a 20k.

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #19 Posted: Sun Mar 21, 2021 1:59 pm 
Lives in gote

Posts: 476
Location: Netherlands
Liked others: 270
Was liked: 147
Rank: EGF 3d
Universal go server handle: gennan
I think the odds of a 10k beating me is many orders of magnitudes greater than the monkeys typing all of Shapespeare's works within a billion years. Occasionally, I make a blunder of 100+ points. I don't know how often, but once in a 100 games or so is not far off, I think. Such odds are not crazy small.

Top
 Profile  
 
Offline
 Post subject: Re: Humans vs. Alpha Go Zero
Post #20 Posted: Sun Mar 21, 2021 2:18 pm 
Lives in gote

Posts: 476
Location: Netherlands
Liked others: 270
Was liked: 147
Rank: EGF 3d
Universal go server handle: gennan
For my own curiosity, I looked up my tournament score against 6d. It's 10-31 over the past 25 years, so about 25% or 200 Elo difference.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 52 posts ]  Go to page 1, 2, 3  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group