Go AI World Championship 2020

For discussing go computing, software announcements, etc.
yoyoma
Lives in gote
Posts: 653
Joined: Mon Apr 19, 2010 8:45 pm
GD Posts: 0
Location: Austin, Texas, USA
Has thanked: 54 times
Been thanked: 213 times

Go AI World Championship 2020

Post by yoyoma »

https://www.reddit.com/r/baduk/comments ... ship_2020/
_autoencoder_ wrote:Hey everyone!

Big news. We are going to be streaming the GO AI World Championship tonight at 9:30pm ET.

I will be hosting and Bob Song, an officially certified Chinese 5d amateur, will be joining for commentary and game insights!

The first match is LeelaZero vs. Golaxy. Here's where you can find it:

Twitch: https://www.twitch.tv/gameofgo
Facebook: https://fb.me/gameofgoapp

YouTube: https://www.youtube.com/channel/UCXqY9R ... TzeEUUAjlA

Hope to see you in the chat! Should be fun :)

https://www.reddit.com/r/baduk/comments ... ournament/

It's the first international tournament for KataGo! Leela is also participating, and the favorite should be Golaxy (I don't see FineArt in the list).
Zerous
Beginner
Posts: 1
Joined: Sun Sep 27, 2020 4:44 am
Rank: AGA 18 kyu
GD Posts: 0

Re: Go AI World Championship 2020

Post by Zerous »

This competition is held in Fuzhou, China, and I am a Chinese, but I can't look the live of this competition!
First, I can't see those sites like reddit, youtube, fb and twitch because of the great wall!
Second, I can't find a live of this competition any Chinese sites!
longshanks
Dies with sente
Posts: 97
Joined: Sat Nov 22, 2014 1:51 am
GD Posts: 0
Been thanked: 14 times

Re: Go AI World Championship 2020

Post by longshanks »

Anyone know if the engines were optimised for the given hardware? It's not uncommon for tuning to be required to get best results.
Vargo
Lives in gote
Posts: 337
Joined: Sat Aug 17, 2013 5:28 am
GD Posts: 0
Has thanked: 22 times
Been thanked: 97 times

Re: Go AI World Championship 2020

Post by Vargo »

some results here
and some comments here

3 timeout and an invalid game in the first round and 4 timeout in the 2nd round :o :scratch:
jann
Lives in gote
Posts: 445
Joined: Tue May 14, 2019 8:00 pm
GD Posts: 0
Been thanked: 37 times

Re: Go AI World Championship 2020

Post by jann »

I don't see the hardware specified any of the links. Is it uniform or each team brings their own?
Vargo
Lives in gote
Posts: 337
Joined: Sat Aug 17, 2013 5:28 am
GD Posts: 0
Has thanked: 22 times
Been thanked: 97 times

Re: Go AI World Championship 2020

Post by Vargo »

Updated results, with... 10 timeouts in the last 3 rounds... HERE
User avatar
wineandgolover
Lives in sente
Posts: 866
Joined: Sun Jul 25, 2010 6:05 am
GD Posts: 0
Has thanked: 318 times
Been thanked: 345 times

Re: Go AI World Championship 2020

Post by wineandgolover »

From Bob Song on discord:

Final results after the qualifying round (top eight advance):
1 MyrtleGo
2 ChaoRan Go
3 Golaxy
4 TianGo
5 Yile Go
6 DolBaram
7 Leela Zero
8 Yinzhe Go
...
9 Katago eliminated

Yike says the katago operator made several mistakes resulting in losing a won game due to time, and decreasing the visits because he underestimated the opponent, which also lead to a loss.
- Brady
Want to see videos of low-dan mistakes and what to learn from them? Brady's Blunders
Javaness2
Gosei
Posts: 1545
Joined: Tue Jul 19, 2011 10:48 am
GD Posts: 0
Has thanked: 111 times
Been thanked: 322 times
Contact:

Re: Go AI World Championship 2020

Post by Javaness2 »

Is there a page with background information on each program. The language it's written in, its authors, blah blah do dah
AloneAgainstAll
Lives with ko
Posts: 127
Joined: Thu May 16, 2019 10:16 am
Rank: KGS 1d
GD Posts: 0
Has thanked: 2 times
Been thanked: 21 times

Re: Go AI World Championship 2020

Post by AloneAgainstAll »

How KataGo operator could make mistake when engine is connected by GTP? Also do operator of KataGo is somehow connected to creator of it? What about LZ? LZ won 4 games, and lost 3 (all by time). Sorry, but for me all of these sounds fishy.
MagRes
Beginner
Posts: 14
Joined: Sat Oct 06, 2018 4:27 pm
Rank: 5k OGS
GD Posts: 0
OGS: brose
Has thanked: 17 times
Been thanked: 14 times

Re: Go AI World Championship 2020

Post by MagRes »

The KataGo developer is not involved with whoever is running "KataGo" in the tournament. (source: Katago Discord)

At this point the whole tournament seems like a pointless exercise with so many timeouts from different programs. This would seem to point to a problem with the organization of the tournament, whether lack of clear communication or coding issue. There are few enough rounds that the timeouts are not just in the noise and seem to have a large effect on which programs advance.
User avatar
wineandgolover
Lives in sente
Posts: 866
Joined: Sun Jul 25, 2010 6:05 am
GD Posts: 0
Has thanked: 318 times
Been thanked: 345 times

Re: Go AI World Championship 2020

Post by wineandgolover »

Even before the tournament, lightvector, Katago's developer, says the it should just be considered as entertainment, and we shouldn't take the results too seriously. Real tests of strength come on equivalent hardware and should be tested with many games.

That said, I am going to start looking at the games. As I do, I can post them here. For example, here is the final round game with katago versus golaxy. Reviewing on katago, it agrees it is way behind pretty early. Either Golaxy was reading way deeper (so better hardware) or katago has a blind spot. Cool game. Should I post games I find interesting?

- Brady
Want to see videos of low-dan mistakes and what to learn from them? Brady's Blunders
bogiesan
Lives in gote
Posts: 533
Joined: Thu Mar 24, 2011 11:00 am
Rank: 13k
GD Posts: 0
Has thanked: 1 time
Been thanked: 136 times

Re: Go AI World Championship 2020

Post by bogiesan »

How did the officials prevent the bots from cheating by conferring with humans?
David Bogie, Boise ID
I play go, I ride a recumbent, of course I use Macintosh.
User avatar
HermanHiddema
Gosei
Posts: 2011
Joined: Tue Apr 20, 2010 10:08 am
Rank: Dutch 4D
GD Posts: 645
Universal go server handle: herminator
Location: Groningen, NL
Has thanked: 202 times
Been thanked: 1086 times

Re: Go AI World Championship 2020

Post by HermanHiddema »

Seems this tournament used a variation of button go.

According to Sensei's Library (https://senseis.xmp.net/?2020WorldArtif ... ompetition) the scoring rule is:
6. Chinese rules, komi is 3.25 stones but if white passes first it's 3.75.
This is similar to WMSG rules in 2008 (https://senseis.xmp.net/?WorldMindSportsGamesRules), which had:
If White passes first, Black's score is reduced by 1. If Black passes first, no such compensation is given.
jann
Lives in gote
Posts: 445
Joined: Tue May 14, 2019 8:00 pm
GD Posts: 0
Been thanked: 37 times

Re: Go AI World Championship 2020

Post by jann »

Yes that sounded stange, I'm pretty sure LZ (and maybe many other simpler bots) cannot be aware of this.
Arcaress
Beginner
Posts: 13
Joined: Mon May 06, 2019 12:28 pm
Rank: OGS 2k
GD Posts: 0
Has thanked: 2 times
Been thanked: 7 times

Re: Go AI World Championship 2020

Post by Arcaress »

LZ timeout in the first game against ChaoRanGo.
Post Reply