Welcome to Download the computer-go-dataset (1,645,958 SGFs)

For discussing go computing, software announcements, etc.
yenw
Beginner
Posts: 9
Joined: Sat Jul 16, 2016 3:07 am
Rank: KGS 9D
GD Posts: 0
KGS: yenw
Been thanked: 2 times

Welcome to Download the computer-go-dataset (1,645,958 SGFs)

Post by yenw »

2005.11.02 - 2016.12.31
TYGEM "9D vs 9D" dataset (1,516,031 games).

2003.09.25 - 2011.12.28
TOM "9D vs 9D" dataset (50,956 games).

1940.01.01 - 2017.01.09
Professional dataset(73,522 games).

2015.10.05 - 2017.06.14
AI dataset (5,449 games).

https://github.com/yenw/computer-go-dataset
Last edited by yenw on Fri Jun 16, 2017 1:14 am, edited 5 times in total.
Krama
Lives in gote
Posts: 436
Joined: Mon Jan 06, 2014 3:46 am
Rank: KGS 5 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 38 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by Krama »

This should be a goldmine for training neural networks.
Sneegurd
Lives with ko
Posts: 129
Joined: Fri Mar 23, 2012 8:57 am
GD Posts: 0
Has thanked: 20 times
Been thanked: 17 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by Sneegurd »

The Tygem stuff set unfortunately not in some readable (by Drago, Sabaki etc.) format, probably there's some heavy grep/sed like action necessary in order to make them an sgf collection :( Beyond my abilities.
Krama
Lives in gote
Posts: 436
Joined: Mon Jan 06, 2014 3:46 am
Rank: KGS 5 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 38 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by Krama »

Marcel Grünauer wrote:The repo has been updated with the GoGoD Winter 2016 games, which is a copyright violation. I therefore recommend to delete this link.
How can someone copyright games played by someone else? That doesn't make any sense.
Amtiskaw
Dies in gote
Posts: 38
Joined: Sun Apr 17, 2016 5:22 am
GD Posts: 0
Has thanked: 4 times
Been thanked: 20 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by Amtiskaw »

The general theory is that you can copyright a large collection of public domain stuff, even if individual items aren't copyrightable, because there was a creative act in choosing what games to include.
yenw
Beginner
Posts: 9
Joined: Sat Jul 16, 2016 3:07 am
Rank: KGS 9D
GD Posts: 0
KGS: yenw
Been thanked: 2 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by yenw »

Updated......
yenw
Beginner
Posts: 9
Joined: Sat Jul 16, 2016 3:07 am
Rank: KGS 9D
GD Posts: 0
KGS: yenw
Been thanked: 2 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by yenw »

Update AI dataset

AlphaGo
..AlphaGo Ke
....AlphaGo vs Ke Jie
......3 games
......2017.05.23 - 2017.05.27
......3W / 0L / 100%
....AlphaGo vs China Team
......1 games
......2017.05.26
......1W / 0L / 100%
....AlphaGo + Lian Xiao vs AlphaGo + Gu Li
......1 games
......2017.05.26
....AlphaGo selfplay
......50 games
..AlphaGo Master
....Master
......60 games
......2016.12.29 - 2017.01.04
......60W / 0L / 100%
..AlphaGo Lee
....AlphaGo vs Lee Sedol
......5 games
......2016.03.09 - 2016.03.15
......4W / 1L / 80%
....AlphaGo selfplay
......3 games
..AlphaGo Fan
....AlphaGo vs Fan Hui
......5 games
......2015.10.05 - 2015.10.09
......5W / 0L / 100%

FineArt
..FineArt
....590 games
....2016.11.01 - 2017.05.12
....454W / 136L / 76.94%
..FineArt UEC
....11 games
....11W / 0L / 100%
..Li Long
....477 games
....2016.10.21 - 2017.06.05
....416W / 61L / 87.21%
..Xing Tian
....45 games
....2016.12.27 - 2017.01.02
....38W / 7L / 84.44%
..Tian Xia Wu Gou
....204 games
....2016.09.28 - 2016.10.31
....159W / 45L / 77.94%
..Sweeper
....55 games
....2016.09.02 - 2016.10.05
....38W / 17L / 69.09%
..Tiger
....63 games
....2016.07.28 - 2016.10.28
....42W / 21L / 66.66%

Zen
..DeepZenGo
....Fox Go Server
....97 games
....2016.11.19 - 2017.06.11
....80W / 17L / 82.47%
..DeepZen(P)
....TYGEM
....2422 games
....2016.12.29 - 2017.05.18
....2007W / 415L / 82.87%
..Zen19L vs Godmoves
....KGS
....3 games
....2016.11.29 - 2016.12.01
....0W / 3L / 0%

Leela
..Leela(P)
....TYGEM
....1354 games
....2017.03.29 - 2017.06.14
....559W / 795L / 41.29%
Last edited by yenw on Fri Jun 16, 2017 1:03 am, edited 1 time in total.
johnsmith
Lives with ko
Posts: 136
Joined: Fri May 27, 2016 3:55 am
Rank: KGS 6 dan
GD Posts: 0
Has thanked: 47 times
Been thanked: 21 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by johnsmith »

yenw wrote: Leela
..Leela(P)
....TYGEM
....1354 games
....2017.03.29 - 2017.06.14
....559W / 795L / 41.29%
Are you sure that this is Leela software and not some pro?

And how can I open professional games, they seem to be in txt format?

Thanks!
Pippen
Lives in gote
Posts: 677
Joined: Thu Sep 16, 2010 3:34 pm
GD Posts: 0
KGS: 2d
Has thanked: 6 times
Been thanked: 31 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by Pippen »

There seems to be no easy way to download the 1.500.000 games, unzip them and plug them into MasterGo or any other database or is there?
yenw
Beginner
Posts: 9
Joined: Sat Jul 16, 2016 3:07 am
Rank: KGS 9D
GD Posts: 0
KGS: yenw
Been thanked: 2 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by yenw »

johnsmith wrote:
yenw wrote: Leela
..Leela(P)
....TYGEM
....1354 games
....2017.03.29 - 2017.06.14
....559W / 795L / 41.29%
Are you sure that this is Leela software and not some pro?

And how can I open professional games, they seem to be in txt format?

Thanks!
No one can play Go all day without rest, so I guess "Leela(P)" is a robot. ^_^
pookpooi
Lives in sente
Posts: 727
Joined: Sat Aug 21, 2010 12:26 pm
GD Posts: 10
Has thanked: 44 times
Been thanked: 218 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by pookpooi »

Doesn't (P) reserved for professional only?
yenw
Beginner
Posts: 9
Joined: Sat Jul 16, 2016 3:07 am
Rank: KGS 9D
GD Posts: 0
KGS: yenw
Been thanked: 2 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by yenw »

pookpooi wrote:Doesn't (P) reserved for professional only?
Do you think DeepZen(P) is a professional player?
pookpooi
Lives in sente
Posts: 727
Joined: Sat Aug 21, 2010 12:26 pm
GD Posts: 10
Has thanked: 44 times
Been thanked: 218 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by pookpooi »

yenw wrote:
pookpooi wrote:Doesn't (P) reserved for professional only?
Do you think DeepZen(P) is a professional player?
No.
This is why I asked if someone knows what is criteria for (P)
yenw
Beginner
Posts: 9
Joined: Sat Jul 16, 2016 3:07 am
Rank: KGS 9D
GD Posts: 0
KGS: yenw
Been thanked: 2 times

Re: Welcome to Download the computer-go-dataset (1,645,958 S

Post by yenw »

update: The 1st World AI Go Open 2017. (40 games)
hyperpape
Tengen
Posts: 4382
Joined: Thu May 06, 2010 3:24 pm
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Location: Caldas da Rainha, Portugal
Has thanked: 499 times
Been thanked: 727 times

Re: Welcome to Download the "computer go dataset" (160K SGFs

Post by hyperpape »

Marcel Grünauer wrote:The repo has been updated with the GoGoD Winter 2016 games, which is a copyright violation. I therefore recommend to delete this link.
Has this been addressed?
Post Reply