Page 1 of 2

Zen gets 8 dan on KGS, while CrazyStone run on phone gets 6d

Posted: Sun Jun 19, 2016 9:10 am
by pookpooi
If we can forget about the whole AlphaGo event, this will be a very big leap for computer go.... no, even with AlphaGo's existence, it's still impressive, consider that Zen run on just 12 cores mac book pro (account: Zen19A), while CrazyStone run on LG Nexus 5 (account: CrazyPhone). Both bots are playing with 15 seconds of 10 byoyomi periods time setting though. And I think we'll get the update of CrazyStone desktop version soon that may fix its bug in 7 dan level. (account: CS2016b)

Posted: Sun Jun 19, 2016 11:15 am
by EdLee
Just like chess apps, some day your watch may give top pros 4 stones. :)

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Sun Jun 19, 2016 5:45 pm
by OtakuViking
pookpooi wrote:I think we'll get the update of CrazyStone desktop version soon that may fix its bug in 7 dan level. (account: CS2016b)


Oh man that would be so good.

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Mon Jun 20, 2016 4:48 am
by Krama
OtakuViking wrote:
pookpooi wrote:I think we'll get the update of CrazyStone desktop version soon that may fix its bug in 7 dan level. (account: CS2016b)


Oh man that would be so good.


Which bug is it? The one where it can't read out ladders?

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Mon Jun 20, 2016 6:57 am
by yoyoma
Pretty impressive, just 6 months after Zen got to 7d. One caveat is that Zen19A started rejecting games with 5 or more handicap (it resigns the game right away, so it doesn't count).

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Mon Jun 20, 2016 8:14 am
by Uberdude
It's currently playing against kingmaker 9d (KGS #2)!

Edit: And won by 7.5 points (no komi)! Wowzers. kingmaker killed a corner with a non-alive outside group and Zen got a lot of profit from hassling it. I think this is a common weak point of humans, we get angry and feel "Hey, you should have lived with your group in gote but you didn't, so I will kill it you naughty bot!". It's almost a trick of bots that exploits human greed. With more experience perhaps kingmaker will do better.


Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Mon Jun 20, 2016 8:19 am
by pookpooi
Uberdude wrote:It's currently playing against Kingmaker 9d!

and won, even though it's not an even game (komi 0.5), still, it has beat many 8d players in an even game.
Also, Aja Huang is like a celebrity when he appear in computer go room, one thing he did say is that AlphaGo is still improving and is much stronger now, and I was like, oh my godddd...

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Mon Jun 20, 2016 9:28 am
by Bonobo
Zen won two of three games against Kingmaker 9d

http://kgs.gosquares.net/index.rhtml.en ... 6&d=20&r=0

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Mon Jun 20, 2016 7:36 pm
by tchan001
Maybe later on KGS will have to adjust the ranking system so that there can still be some slots left reserved for humans to be ranked as 9d.

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Tue Jun 21, 2016 1:40 am
by Uberdude
I'd like to see a Haylee vs Zen match!

Zen is now 4-1 against kingmaker 9d (though no komi games) and 4-2 against cloudnotes (strong 8d, used to be 9d). It seems to do less well with handicap against weaker players, and there is a guest (TACO2, apparently a Tygem 9d) with a winning record in even games. It seems Zen would be 9d if it played even games, the handicap games might hold its rank bank (plus the inertia of KGS ranks).

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Tue Jun 21, 2016 6:04 am
by Mike Novack
Uberdude wrote:I'd like to see a Haylee vs Zen match!

It seems to do less well with handicap against weaker players.


That might very well be that the new version hasn't yet had the fine tuning adjustments for letting the algorithm play a handicap game in the first place. The mechanisms by which these programs are able to play handicap games aren't as straight forward as you might think.

For example, the "straight" MCTS programs might use something like "dynamic komi" << in deciding who has won a playout, a temporary reverse komi of X amount used >> with that dynamic komi decreasing as the game progresses. But what its initial value should be and the rate of decrease would need to be determined for each number of handicap stones. A lot of trial and error and that takes time and data (games played at that handicap).

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Tue Jun 21, 2016 6:29 am
by pookpooi
Hideki said that "It's well known that MC bots are not good at (high) handicap games." True to his words, even now Zen begins to has problem with 4 stones handicap games.

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Wed Jun 22, 2016 2:32 am
by Babelardus
Uberdude wrote:It's currently playing against kingmaker 9d (KGS #2)!

Edit: And won by 7.5 points (no komi)! Wowzers.


So komi is 0.5... if Kingmaker had played with komi at 6.5, he'd have 6 points more; Zen would still have won by 1.5 points.

I think that the internet has to rewrite the phrase: "Computers can't play go well. The best programs only play between 5 and 10 kyu. Most talented amateurs can beat them after a few months of practicing."

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Wed Jun 22, 2016 2:41 am
by pookpooi
Babelardus wrote:I think that the internet has to rewrite the phrase: "Computers can't play go well. The best programs only play between 5 and 10 kyu. Most talented amateurs can beat them after a few months of practicing."

Haven't these sentences rewrote ten years ago, since the implementation of monte carlo tree search in 2006?

Re: Zen gets 8 dan on KGS, while CrazyStone run on phone get

Posted: Wed Jun 22, 2016 3:00 am
by Babelardus
pookpooi wrote:
Babelardus wrote:I think that the internet has to rewrite the phrase: "Computers can't play go well. The best programs only play between 5 and 10 kyu. Most talented amateurs can beat them after a few months of practicing."

Haven't these sentences rewrote ten years ago, since the implementation of monte carlo tree search in 2006?


On some sites yes, but there are still many that state that computers can't play Go above mid-range amateur level :)