how to compare gnugo AI with kyu level?

If you're new to the game and have questions, post them here.
Post Reply
shia
Beginner
Posts: 1
Joined: Sun Dec 20, 2020 5:41 am
GD Posts: 0

how to compare gnugo AI with kyu level?

Post by shia »

I was playing against godroid on my phone, it was my first "serious" game after I just read several tactis and background and did some "dirty" games without thinking a lot against the phone. I won the game by 20:14.5 with 2 stones handicap and 5.5 komi and AI strength level 1.

Now I wonder, what kyu represents AI strength 1? Somewhere I read, that
GNU Go is an AI engine that plays Go at about 8 to 12 kyu strength.
so that means, level 1 strength is 12kyu? That would make me kyu14 if I can steadily win that configuration (and of course would to have test this against human players as well), but I dont really think that is true because I just started.
So, can you even compare the gnugo AI that way to know in what range of kyu you are?
skydyr
Oza
Posts: 2495
Joined: Wed Aug 01, 2012 8:06 am
GD Posts: 0
Universal go server handle: skydyr
Online playing schedule: When my wife is out.
Location: DC
Has thanked: 156 times
Been thanked: 436 times

Re: how to compare gnugo AI with kyu level?

Post by skydyr »

It's hard to make good comparisons with human levels for bots using traditional methods like that. First, they tend to make weird mistakes compared to humans, and so beating them at a level doesn't necessarily translate to a specific human level, but more of a range. Second, their strength is often based on their computation resources, and so depending on your phone and whatever else is running on it, it may be higher or lower.

If you're curious about your specific level, just play 5-10 games on KGS or OGS or something and see where you stand.
User avatar
jlt
Gosei
Posts: 1786
Joined: Wed Dec 14, 2016 3:59 am
GD Posts: 0
Has thanked: 185 times
Been thanked: 495 times

Re: how to compare gnugo AI with kyu level?

Post by jlt »

The bot GnuGo2 is 11k on KGS (a few years ago, GnuGo was 12k, so KGS ranks may have become weaker). I don't know how this compares to AI Level 1 on GoDroid.
pajaro
Lives in gote
Posts: 558
Joined: Tue Mar 23, 2021 6:13 am
GD Posts: 0
KGS: pajaro
IGS: pajaro
Has thanked: 28 times
Been thanked: 142 times

Re: how to compare gnugo AI with kyu level?

Post by pajaro »

If a (non learning) bot plays in a server, with many different people, it will tend to be in a specific rating. If the rating system of the server sucks, then that's another issue.

But if you play the same bot several times, you will notice that it becomes easier and easier to beat it, even if you are not becoming a better player. That's because, as a human (you are human, right?) you adapt your style and way of playing to that specific player (=bot) even if you don't realize. You aren't improving, you just learn how to take advantage of the bot's flaws.

So I wouldn't use gnugo to rate your own strength.
kvasir
Lives in sente
Posts: 1040
Joined: Sat Jul 28, 2012 12:29 am
Rank: panda 5 dan
GD Posts: 0
IGS: kvasir
Has thanked: 25 times
Been thanked: 187 times

Re: how to compare gnugo AI with kyu level?

Post by kvasir »

If you post some game record then I think you might get some advise on how to set your rank on servers or in real life. However, ranks are mostly about playing games in a setting that you like against other humans so comparing to GnuGo won't be a good estimate. For one thing people often play GnuGo without a clock and often have played hundreds of games with it already. It is a bit like a solitaire because you just get a little bit better at beating GnuGo every time you try because it makes similar moves in the same situations and is easily tricked.
User avatar
CDavis7M
Lives in sente
Posts: 716
Joined: Tue Jun 15, 2010 2:18 pm
Rank: Shokyu
GD Posts: 0
Universal go server handle: CDavis7M
Has thanked: 109 times
Been thanked: 140 times
Contact:

Re: how to compare gnugo AI with kyu level?

Post by CDavis7M »

shia wrote:I was playing against godroid on my phone, it was my first "serious" game after I just read several tactis and background and did some "dirty" games without thinking a lot against the phone. I won the game by 20:14.5 with 2 stones handicap and 5.5 komi and AI strength level 1.

Now I wonder, what kyu represents AI strength 1? Somewhere I read, that
There is an Android phone application for the Online Go Server.

If you want a decent idea on your rank, there are a few easy options on the OGS app. Don't click "Play Against AI" because that is playing against the strong KataGo AI. Instead, click "Custom Game" and then for "Opponent" you can choose weaker AI bots across a wide range of ranks, 26kyu, 21kyu, 12kyu, and so on, up to 9dan.
Post Reply