It is currently Wed Apr 24, 2024 11:09 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 46 posts ]  Go to page Previous  1, 2, 3
Author Message
Offline
 Post subject: Re: www.goratings.org is online with ratings of top professi
Post #41 Posted: Thu Apr 07, 2016 7:05 am 
Honinbo

Posts: 9545
Liked others: 1600
Was liked: 1711
KGS: Kirby
Tygem: 커비라고해
hyperpape, all I am arguing is that we need more data to make more confident assumptions. Lee Sedol and Iyama Yuna haven't played one another much, so we don't know much about what their relative placement should be.

In the same way, Iyama Yuta hasn't played a lot of people on the list, so it's hard to know what his actual placement should be.

The set of people that have played each other more often - those guys - we know more about their relative placement.

End of story.

_________________
be immersed

Top
 Profile  
 
Offline
 Post subject: Re: www.goratings.org is online with ratings of top professi
Post #42 Posted: Thu Apr 07, 2016 8:17 am 
Honinbo

Posts: 9545
Liked others: 1600
Was liked: 1711
KGS: Kirby
Tygem: 커비라고해
Also, I should clarify something.

I am not saying that it is impossible to project an assumption about Iyama's position internationally. Goratings.org has done that, and in my opinion, the placement is probably pretty good. But I do believe that more data among players in the population makes the placement assumption more accurate. If Iyama Yuta keeps playing those nearby him in the list, we can have more confidence in where he should be. So naturally, players that have played one another more on this list - we can be more confident of our assumptions about those guys, because we have more data.

It would be nice to quantify our certainty in some way of the ratings. So for players that have played most of the people on the list many times, we'd be able to see more confidence in our assumption about their placement. Whereas if you have a player that has only played 2 games, we could express our confidence in that guy's placement as being weak (e.g. maybe he got lucky).

_________________
be immersed

Top
 Profile  
 
Offline
 Post subject: Re: www.goratings.org is online with ratings of top professi
Post #43 Posted: Thu Apr 07, 2016 8:58 am 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Kirby wrote:
Also, I should clarify something.

I am not saying that it is impossible to project an assumption about Iyama's position internationally. Goratings.org has done that, and in my opinion, the placement is probably pretty good. But I do believe that more data among players in the population makes the placement assumption more accurate. If Iyama Yuta keeps playing those nearby him in the list, we can have more confidence in where he should be. So naturally, players that have played one another more on this list - we can be more confident of our assumptions about those guys, because we have more data.

It would be nice to quantify our certainty in some way of the ratings. So for players that have played most of the people on the list many times, we'd be able to see more confidence in our assumption about their placement. Whereas if you have a player that has only played 2 games, we could express our confidence in that guy's placement as being weak (e.g. maybe he got lucky).
I agree with this post, though I would reframe it a bit:

There's already a concept of confidence in the model and I believe Remi tweaked the display to show the lower bound of the confidence interval: viewtopic.php?p=190653#p190653.

With Iyama, I suspect that the model has normal-high confidence in his rating, since he's played many games. We're all standing around speculating as to whether the model reliably/accurately reflects reality.

_________________
Occupy Babel!

Top
 Profile  
 
Offline
 Post subject: Re: www.goratings.org is online with ratings of top professi
Post #44 Posted: Thu Apr 07, 2016 9:56 am 
Honinbo

Posts: 9545
Liked others: 1600
Was liked: 1711
KGS: Kirby
Tygem: 커비라고해
hyperpape wrote:
With Iyama, I suspect that the model has normal-high confidence in his rating, since he's played many games.


I guess the only part where my opinion differs is that I think that high confidence should come from the rating if he has played many games against many different people from the population that he is being ranked in.

To give an extreme example, if he only played one guy on the list a million times, I'd personally have little confidence in whatever ranking we give him, even if he won (or lost) all of the time against that guy.

_________________
be immersed

Top
 Profile  
 
Offline
 Post subject: Re: www.goratings.org is online with ratings of top professi
Post #45 Posted: Thu Apr 07, 2016 10:13 am 
Lives in sente

Posts: 727
Liked others: 44
Was liked: 218
GD Posts: 10
Kirby wrote:
hyperpape wrote:
With Iyama, I suspect that the model has normal-high confidence in his rating, since he's played many games.


I guess the only part where my opinion differs is that I think that high confidence should come from the rating if he has played many games against many different people from the population that he is being ranked in.


Last month I count the nation of pro in goratings
Japan 333
China 251
South Korea 193
Taiwan 28

So maybe this is the problem, since Iyama Yuta play with the biggest group of the population (Japan), it'll continue to give him a good record
But the model will still give a good prediction, since it's more likely that he'll continue to play a lot of domestic games. If you lower the Elo of Iyama Yuta, it might reflect a better prediction for game against Korean/Chinese pro (which he rarely play) and worse prediction for domestic game (which he'll play a lot)

Top
 Profile  
 
Offline
 Post subject: Re: www.goratings.org is online with ratings of top professi
Post #46 Posted: Thu Apr 07, 2016 12:12 pm 
Honinbo

Posts: 9545
Liked others: 1600
Was liked: 1711
KGS: Kirby
Tygem: 커비라고해
pookpooi wrote:
If you lower the Elo of Iyama Yuta, it might reflect a better prediction for game against Korean/Chinese pro (which he rarely play) and worse prediction for domestic game (which he'll play a lot)


I agree. It would almost make sense to calculate rating in a different way, depending on the page you are viewing. The ranking/results you are aggregating should reflect the dataset it was calculated from.

I also agree that the model can have good prediction, given that the dataset Remi uses is representative (and continues to be representative) of all of the games that pros play. If the dataset doesn't include all games we know about, it could be skewed.

_________________
be immersed


This post by Kirby was liked by: pookpooi
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 46 posts ]  Go to page Previous  1, 2, 3

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group