It is currently Mon May 20, 2019 11:25 pm

 All times are UTC - 8 hours [ DST ]

 Page 6 of 6 [ 108 posts ] Go to page Previous  1, 2, 3, 4, 5, 6
 Print view Previous topic | Next topic
Author Message
 Post subject: Re: Iyama's world ranking #101 Posted: Sat Feb 16, 2019 2:06 am
 Dies with sente

Posts: 88
Liked others: 9
Was liked: 7
Rank: 4K
jlt wrote:
Park Yeonghun has recently beaten strong opponents like Park Junghwan (3630) and Gu Zihao (3593), but also lost against low rated players like Kim Hyenchan (3246) and Song Gyusang (3329).

I wanted to check by myself if Iyama's rating reflects his performance against Chinese and Korean players. I considered a player with initial rating 3470, and I made him play the same 17 matches than Iyama's since January 2018 with the same result, and repeated that 10000 times. After each of the 17000 matches, the rating is incremented by c(match_result - 1/(10D/100+1)) where c=20 is an arbitrary constant and D is the difference between the opponent's rating and the current player's rating.

The player ended with a rating of... 3339 points, which puts him at the 98th place on goratings.

The constant c=20 is arbitrary, but changing it to other reasonable values (between 1 and 40) doesn't change the conclusion much.

I repeated the same experiment with the 14 matches in 2017 against Chinese and Korean opponents. The final rating is 3524, which corresponds to the 15th place.

If we take into account all the 31 matches since January 2017, we get a rating of 3410 (rank=54th).

My conclusion is that maybe Iyama is a bit overrated, but the variations are so wild that it's impossible to get a reliable rating by only taking into account non-Japanese opponents.

Here is a scilab code, for those who would like to check.

rating=3470;

opp_ratings=[3652,3652,3639,3519,3641,3587,3475,3496,3502,3502,3500,3609,3531,3631,3578,3488,3516,3517,3517,3431,3647,3565,3447,3588,3585,3448,3483,2969,3458,3465,3542];

match_results=[1,0,0,0,0,0,1,1,0,1,0,0,1,1,0,0,0,1,0,0,0,0,0,1,0,0,0,1,1,1,0];

n=length(opp_ratings);
c=20;

for number_of_loops=1:10000;

for i=1:n;
D=opp_ratings(i)-rating;
S=1/(10^(D/400)+1);
rating=rating+c*(match_results(i)-S);
end

end
disp(rating)

By the way, is it possible to do the same analysis for Japanese players collectively? I wonder, no, I suspect that Goratings overestimates Japanese players collectively. I know nothing about statistics, but here's what a Reddit user who does had to say about this matter (https://www.reddit.com/r/baduk/comments/71je7h/world_rankings/):
Quote:
Hi Remi, I don't know too much about Taeil Bai's method. The rating system I usually follow is mamumamu. I agree with you that incremental ratings systems don't work well, and that your system is far superior to those.

My criticism of your system comes when comparing it to mamumamu's ratings. http://sports.geocities.jp/mamumamu0413/total.html It uses Glicko2-system for matches between strongly connected players and MLE concurrent with Glicko2 for international matches.

First, please allow me to confess that my understanding of statistics is probably elementary compared to yours. So I would appreciate patience in enlightening me if my criticism stems from my own ignorance.

When looking at Iyama Yuta's rating. He is current 3546 compared to Ke Jie at 3668. This suggests Iyama Yuta has a 33% chance of winning against Ke Jie. If you look at Mamumamu, it is 9.79 for Iyama Yuta and 10.867 for Ke Jie, which suggests a 22% win rate. This suggests mamumamu and goratings are off by about 100elo for Iyama Yuta.

When compiling the last 19 games (all games since 1/1/2015) of data for Iyama Yuta vs Chinese/Korean professionals, he has 8 wins when I calculate 9.8 wins expected based on goratings.org. This suggests his elo is about 70 points higher than it is. However, it is not statistically significant, as the deviation is less than 1 sigma. However, it is hard to get a statistically significant result with only 19 samples.

If I look at the next highest ranked Japanese player. Ichiriki Ryo. He has played 40 games against Chinese/Korean pros since 1/1/2015. Based on ratings from goratings I expect 16.8 wins, but there were 10. With Ichiriki Ryo, the deviation is just over 2sigma.

If combining the data for Iyama and Ichiriki, the deviation is well over 2sigma, but still under 3 sigma. Adding in more players from Japan to this, or taking the whole data for Japan vs China/Korea matches should further support this point.

I understand that I am only looking at part of the data, and ignoring the passage of time. However, I'm systematically picking out games that fit a certain neutral criteria, then calculating the expected # of wins and comparing to the actual # of wins and finding a statistically significant deviation. As ratings are used to predict future win probability, this suggests to me a flaw in the methodology used to produce the ratings.

My theory is that, although WHR does work better than incremental methods for strongly connected groups of players, it does not work well enough. My theory is further supported if you do a similar analysis for Taiwan vs China/Korea and NA/EU vs China/Korea. China and Korea play many games against each other, but there are far fewer opportunities for Japan/Taiwan/NA/EU to play against China/Korea.

FYI this is the description of mamumamu's methodology. http://sports.geocities.jp/mamumamu0413 ... le004.html He uses glicko2 first to calculate ratings for each country, then uses MLE to adjust the ratings for regional differences, accounting for the fact that glicko2 is insufficient for this adjustment.

Top

 Post subject: Re: Iyama's world ranking #102 Posted: Wed Apr 10, 2019 4:31 am
 Dies with sente

Posts: 88
Liked others: 9
Was liked: 7
Rank: 4K
Iyama has dropped to #60 on Mamumanu's world ranking.

http://mamumamu0413.web.fc2.com/rating/world/ranking.html

Top

 Post subject: Re: Iyama's world ranking #103 Posted: Wed Apr 10, 2019 7:27 am
 Judan

Posts: 5800
Location: Cambridge, UK
Liked others: 328
Was liked: 3103
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Seems entirely reasonable: he's no longer so dominant in Japan, losing two titles, going to the wire against Yamashita in the Kisei, some surprising losses in the leagues. Meanwhile the hoard of strong Chinese youngsters is growing in number and strength so even if he'd maintained the same performance and rating his place would have dropped. Nevertheless, although any random Chinese kid you've never heard of at #60 could upset a top 5 player like Ke Jie on a good day, I still think Iyama would have better chances. His rating takes quite a knock for each loss as he's mostly playing weaker players in Japan, and his wins won't raise it much.

Top

 Post subject: Re: Iyama's world ranking #104 Posted: Sat Apr 20, 2019 3:24 am
 Dies with sente

Posts: 88
Liked others: 9
Was liked: 7
Rank: 4K
Iyama has dropped to 38th place on goratings.org. This is more like it, but it still significantly inflates Iyama's strength, as it does all Japanese players. Meanwhile, Mamumanu's world ranking has Iyama at 60th place, which is a far more realistic assessment, in my opinion.

Top

 Post subject: Re: Iyama's world ranking #105 Posted: Sat Apr 20, 2019 7:22 am
 Lives in sente

Posts: 896
Location: UK
Liked others: 68
Was liked: 467
Rank: 5 dan
KGS: macelee
More interesting is that Ichiriki Ryo is at 36th, two positions above him.

Top

 Post subject: Re: Iyama's world ranking #106 Posted: Sat Apr 20, 2019 10:19 am
 Tengen

Posts: 4237
Location: North Carolina
Liked others: 439
Was liked: 692
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 3k
Can anyone who knows Mamumanu’s system comment on how much weaker it thinks Iyama is today than at his peak? It seems like goratings has drastically downgraded him (from a probably inflated peak), while Mamumanu has made a smaller adjustment (from a more accurate starting point).

_________________
Occupy Babel!

Top

 Post subject: Re: Iyama's world ranking #107 Posted: Sat Apr 20, 2019 12:14 pm
 Dies with sente

Posts: 88
Liked others: 9
Was liked: 7
Rank: 4K
macelee wrote:
More interesting is that Ichiriki Ryo is at 36th, two positions above him.

Inflated! Goratings cannot be trusted when it comes to Japanese players. Mamumamu ranks Ichiriki at 75th, still 15 places behind Iyama.

Top

 Post subject: Re: Iyama's world ranking #108 Posted: Sat Apr 20, 2019 1:53 pm
 Lives in gote

Posts: 381
Liked others: 37
Was liked: 114
Here are Iyama's and Ichiriki's rankings according to jlt's ranking system described a few messages above (assuming I didn't misclick, as I did a lot of manipulations by hand on Openoffice).

1) If we only take into account the most recent matches against Chinese and Korean opponents during a period of 1 year, then Iyama gets an Elo rating of 3409 (56th) and Ichiriki's rating is 3410 (55th).

2) Same thing for 2 years instead of 1 year: Iyama's rating is 3421 (47th) and Ichiriki's is 3343 (93th).

I wouldn't say any of these rankings is reliable since they fluctuate too much, but they do reflect the fact that Iyama's level has decreased while Ichiriki is catching up.

The calculation (1) doesn't take into account Iyama's 4 recent losses (3 against Murakawa and 1 against Ichiriki).

 This post by jlt was liked by: TheCannyOnion
Top

 Display posts from previous: All posts1 day7 days2 weeks1 month3 months6 months1 year Sort by AuthorPost timeSubject AscendingDescending
 Page 6 of 6 [ 108 posts ] Go to page Previous  1, 2, 3, 4, 5, 6

 All times are UTC - 8 hours [ DST ]

#### Who is online

Users browsing this forum: Google [Bot], zermelo and 3 guests

 You cannot post new topics in this forumYou cannot reply to topics in this forumYou cannot edit your posts in this forumYou cannot delete your posts in this forumYou cannot post attachments in this forum

Search for:
 Jump to:  Select a forum ------------------ Life In 19x19.com General Topics    Introductions and Guidelines    Off Topic    Announcements    General Go Chat    Beginners    Amateurs    Professionals       Lee Sedol vs Gu Li    Go Rules    Forum/Site Suggestions and Bugs    Creative writing    Tournaments       Ride share to tournaments Improve Your Game    Game Analysis    Study Group    Teachers/Club Leaders       Teacher advertisements    Study Journals L19²GO (Malkovich)    1-on-1 Malkovich games    Big Brother Malkovich games    Rengo Games    Other versions of turn-based games Go Gear    Go Books    Go Book Reviews    Computer Go    Gobans and other equipment    Trading Post    New Products/Upgrades/Sales Go Club Forums    Go Club Discussions       Honinbo Go League    American Go Association Forum       Go Congress 2011 volunteers       AGA volunteers ( non-congress)    Australian Go Association    European Go Federation Forum    Singapore Weiqi Association    KGS    ASR League    IGS    OGS    Tygem    WBaduk    Turn Based Servers    Insei League Events    Kaya.gs       King of the Hill
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group