Yes, that would help. My code already uses 'C' internally for computers, if you don't mind using it instead of 'A'.macelee wrote:I should have let Rémi know when I include more AI games into the underlying database. I think these games are of really good quality now and provide very good studying materials. So it is right to have them included in a Go database.
Rémi, would it be helpful if I modify the data feed I supply and give AI players a new value in the 'SEX' field? Currently we have only 'M' for male and 'F' for female players. I can add an 'A' value for AI players. It should be really easy to filter them out from your side.
http://www.goratings.org/ now has historical ratings lists
-
Rémi
- Lives with ko
- Posts: 170
- Joined: Sat Jan 14, 2012 4:11 pm
- Rank: KGS 4 kyu
- GD Posts: 0
- Has thanked: 32 times
- Been thanked: 119 times
- Contact:
Re: http://www.goratings.org/ now has historical ratings lis
-
macelee
- Lives in sente
- Posts: 928
- Joined: Mon Dec 31, 2012 1:46 pm
- Rank: 5 dan
- GD Posts: 0
- KGS: macelee
- Location: UK
- Has thanked: 72 times
- Been thanked: 480 times
- Contact:
Re: http://www.goratings.org/ now has historical ratings lis
Done! Those AI players are now marked by 'C' in the data feed.
My data also contains games from Taiwanese AI CGI. And I will add more games by Chinese AI abacus. Both of these are playing at strong professional plus level now.
My data also contains games from Taiwanese AI CGI. And I will add more games by Chinese AI abacus. Both of these are playing at strong professional plus level now.
-
pookpooi
- Lives in sente
- Posts: 727
- Joined: Sat Aug 21, 2010 12:26 pm
- GD Posts: 10
- Has thanked: 44 times
- Been thanked: 218 times
Re: http://www.goratings.org/ now has historical ratings lis
This new ranking method claimed to be better than yours. Do you have any comment on this?
https://www.sciencedirect.com/science/a ... 1717306574
https://www.sciencedirect.com/science/a ... 1717306574
-
dfan
- Gosei
- Posts: 1599
- Joined: Wed Apr 21, 2010 8:49 am
- Rank: AGA 2k Fox 3d
- GD Posts: 61
- KGS: dfan
- Has thanked: 891 times
- Been thanked: 534 times
- Contact:
Re: http://www.goratings.org/ now has historical ratings lis
It doesn't seem to me that they claim it is "better than WHR". They do note that WHR has high computational cost and only works for players with both wins and losses. In general one can handle undefeated players by incorporating a prior (otherwise there's no way to predict an undefeated player will ever lose); I haven't thought about whether this would be trivial or hard to fit into WHR if you wanted.pookpooi wrote:This new ranking method claimed to be better than yours. Do you have any comment on this?
https://www.sciencedirect.com/science/a ... 1717306574
They do not seem to have any quantitative evaluation of their method other than computation time. In particular, I don't see any place where they attempt to characterize how accurate their system is at making predictions; as far as I can tell the paper is basically just "here's the motivation for our system; here's our system; here's how it rates some top players". Given that, I don't really see how you can compare its quality in any sense other than speed (and I find it hard to believe that Glicko, which they mention but don't compare their system to, would be any slower).
-
Rémi
- Lives with ko
- Posts: 170
- Joined: Sat Jan 14, 2012 4:11 pm
- Rank: KGS 4 kyu
- GD Posts: 0
- Has thanked: 32 times
- Been thanked: 119 times
- Contact:
Re: http://www.goratings.org/ now has historical ratings lis
Thanks for letting me know about this paper. I was not aware of it.pookpooi wrote:This new ranking method claimed to be better than yours. Do you have any comment on this?
https://www.sciencedirect.com/science/a ... 1717306574
The method looks to be of little practical value. The paper does not claim that the method is better than WHR. It does not measure the quality of predictions made by the method at all. And it seems it does not consider the variation of player strength in time. I don't have time to read the paper in details. It ranks Lee Sedol first, ahead of Gu Li (6th), and Ke Jie (9th). That's enough to make me not want to invest more time reading it.
-
Rémi
- Lives with ko
- Posts: 170
- Joined: Sat Jan 14, 2012 4:11 pm
- Rank: KGS 4 kyu
- GD Posts: 0
- Has thanked: 32 times
- Been thanked: 119 times
- Contact:
Re: http://www.goratings.org/ now has historical ratings lis
I use a prior in WHR, and compute the ratings of players with 100% wins and 100% losses. I just don't display them on the web site, because they are likely to be very inaccurate.dfan wrote:In general one can handle undefeated players by incorporating a prior (otherwise there's no way to predict an undefeated player will ever lose); I haven't thought about whether this would be trivial or hard to fit into WHR if you wanted.