It is currently Wed Nov 22, 2017 10:15 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 21 posts ]  Go to page 1, 2  Next
Author Message
Offline
 Post subject: Welcome to Download the computer-go-dataset (1,645,958 SGFs)
Post #1 Posted: Wed Apr 12, 2017 12:53 pm 
Beginner

Posts: 8
Liked others: 0
Was liked: 2
Rank: KGS 9D
KGS: yenw
2005.11.02 - 2016.12.31
TYGEM "9D vs 9D" dataset (1,516,031 games).

2003.09.25 - 2011.12.28
TOM "9D vs 9D" dataset (50,956 games).

1940.01.01 - 2017.01.09
Professional dataset(73,522 games).

2015.10.05 - 2017.06.14
AI dataset (5,449 games).

https://github.com/yenw/computer-go-dataset


Last edited by yenw on Fri Jun 16, 2017 1:14 am, edited 5 times in total.

This post by yenw was liked by: luigi
Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #2 Posted: Wed Apr 12, 2017 3:38 pm 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
This should be a goldmine for training neural networks.

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #3 Posted: Fri Apr 14, 2017 12:59 pm 
Lives in gote

Posts: 447
Location: Vienna, Austria
Liked others: 206
Was liked: 205
The repo has been updated with the GoGoD Winter 2016 games, which is a copyright violation. I therefore recommend to delete this link.


This post by Marcel Grünauer was liked by 4 people: Bill Spight, Bonobo, ez4u, Rémi
Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #4 Posted: Fri Apr 14, 2017 11:35 pm 
Dies with sente

Posts: 96
Liked others: 4
Was liked: 8
The Tygem stuff set unfortunately not in some readable (by Drago, Sabaki etc.) format, probably there's some heavy grep/sed like action necessary in order to make them an sgf collection :( Beyond my abilities.

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #5 Posted: Sat Apr 15, 2017 2:50 am 
Lives in gote

Posts: 447
Location: Vienna, Austria
Liked others: 206
Was liked: 205
[Deleted]


Last edited by Marcel Grünauer on Sun Apr 16, 2017 3:03 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #6 Posted: Sat Apr 15, 2017 2:59 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
Marcel Grünauer wrote:
The repo has been updated with the GoGoD Winter 2016 games, which is a copyright violation. I therefore recommend to delete this link.


How can someone copyright games played by someone else? That doesn't make any sense.

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #7 Posted: Sat Apr 15, 2017 3:04 am 
Dies in gote

Posts: 24
Liked others: 4
Was liked: 14
The general theory is that you can copyright a large collection of public domain stuff, even if individual items aren't copyrightable, because there was a creative act in choosing what games to include.

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #8 Posted: Mon Apr 17, 2017 2:50 am 
Beginner

Posts: 8
Liked others: 0
Was liked: 2
Rank: KGS 9D
KGS: yenw
Updated......

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #9 Posted: Thu Jun 15, 2017 10:10 am 
Beginner

Posts: 8
Liked others: 0
Was liked: 2
Rank: KGS 9D
KGS: yenw
Update AI dataset

AlphaGo
..AlphaGo Ke
....AlphaGo vs Ke Jie
......3 games
......2017.05.23 - 2017.05.27
......3W / 0L / 100%
....AlphaGo vs China Team
......1 games
......2017.05.26
......1W / 0L / 100%
....AlphaGo + Lian Xiao vs AlphaGo + Gu Li
......1 games
......2017.05.26
....AlphaGo selfplay
......50 games
..AlphaGo Master
....Master
......60 games
......2016.12.29 - 2017.01.04
......60W / 0L / 100%
..AlphaGo Lee
....AlphaGo vs Lee Sedol
......5 games
......2016.03.09 - 2016.03.15
......4W / 1L / 80%
....AlphaGo selfplay
......3 games
..AlphaGo Fan
....AlphaGo vs Fan Hui
......5 games
......2015.10.05 - 2015.10.09
......5W / 0L / 100%

FineArt
..FineArt
....590 games
....2016.11.01 - 2017.05.12
....454W / 136L / 76.94%
..FineArt UEC
....11 games
....11W / 0L / 100%
..Li Long
....477 games
....2016.10.21 - 2017.06.05
....416W / 61L / 87.21%
..Xing Tian
....45 games
....2016.12.27 - 2017.01.02
....38W / 7L / 84.44%
..Tian Xia Wu Gou
....204 games
....2016.09.28 - 2016.10.31
....159W / 45L / 77.94%
..Sweeper
....55 games
....2016.09.02 - 2016.10.05
....38W / 17L / 69.09%
..Tiger
....63 games
....2016.07.28 - 2016.10.28
....42W / 21L / 66.66%

Zen
..DeepZenGo
....Fox Go Server
....97 games
....2016.11.19 - 2017.06.11
....80W / 17L / 82.47%
..DeepZen(P)
....TYGEM
....2422 games
....2016.12.29 - 2017.05.18
....2007W / 415L / 82.87%
..Zen19L vs Godmoves
....KGS
....3 games
....2016.11.29 - 2016.12.01
....0W / 3L / 0%

Leela
..Leela(P)
....TYGEM
....1354 games
....2017.03.29 - 2017.06.14
....559W / 795L / 41.29%


Last edited by yenw on Fri Jun 16, 2017 1:03 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #10 Posted: Thu Jun 15, 2017 10:55 am 
Dies in gote

Posts: 60
Liked others: 7
Was liked: 6
Rank: KGS 6 dan
yenw wrote:
Leela
..Leela(P)
....TYGEM
....1354 games
....2017.03.29 - 2017.06.14
....559W / 795L / 41.29%


Are you sure that this is Leela software and not some pro?

And how can I open professional games, they seem to be in txt format?

Thanks!

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #11 Posted: Thu Jun 15, 2017 11:33 am 
Lives in gote

Posts: 580
Liked others: 4
Was liked: 28
KGS: 3D
Tygem: 5D
There seems to be no easy way to download the 1.500.000 games, unzip them and plug them into MasterGo or any other database or is there?

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #12 Posted: Fri Jun 16, 2017 12:46 am 
Beginner

Posts: 8
Liked others: 0
Was liked: 2
Rank: KGS 9D
KGS: yenw
johnsmith wrote:
yenw wrote:
Leela
..Leela(P)
....TYGEM
....1354 games
....2017.03.29 - 2017.06.14
....559W / 795L / 41.29%


Are you sure that this is Leela software and not some pro?

And how can I open professional games, they seem to be in txt format?

Thanks!

No one can play Go all day without rest, so I guess "Leela(P)" is a robot. ^_^

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #13 Posted: Fri Jun 16, 2017 12:49 am 
Lives in gote

Posts: 607
Liked others: 41
Was liked: 191
GD Posts: 10
Doesn't (P) reserved for professional only?

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #14 Posted: Fri Jun 16, 2017 12:55 am 
Beginner

Posts: 8
Liked others: 0
Was liked: 2
Rank: KGS 9D
KGS: yenw
pookpooi wrote:
Doesn't (P) reserved for professional only?


Do you think DeepZen(P) is a professional player?

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #15 Posted: Fri Jun 16, 2017 4:13 am 
Lives in gote

Posts: 607
Liked others: 41
Was liked: 191
GD Posts: 10
yenw wrote:
pookpooi wrote:
Doesn't (P) reserved for professional only?


Do you think DeepZen(P) is a professional player?

No.
This is why I asked if someone knows what is criteria for (P)

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the computer-go-dataset (1,645,958 S
Post #16 Posted: Fri Aug 18, 2017 6:11 am 
Beginner

Posts: 8
Liked others: 0
Was liked: 2
Rank: KGS 9D
KGS: yenw
update: The 1st World AI Go Open 2017. (40 games)

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #17 Posted: Fri Aug 18, 2017 7:47 am 
Tengen

Posts: 4044
Location: North Carolina
Liked others: 411
Was liked: 662
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
Marcel Grünauer wrote:
The repo has been updated with the GoGoD Winter 2016 games, which is a copyright violation. I therefore recommend to delete this link.
Has this been addressed?

_________________
Occupy Babel!


This post by hyperpape was liked by: Drew
Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #18 Posted: Sat Aug 19, 2017 12:15 am 
Lives in gote

Posts: 447
Location: Vienna, Austria
Liked others: 206
Was liked: 205
hyperpape wrote:
Marcel Grünauer wrote:
The repo has been updated with the GoGoD Winter 2016 games, which is a copyright violation. I therefore recommend to delete this link.
Has this been addressed?


It has been removed with a commit shortly afterwards but due to the nature of git it's still in the history. So if you know where to look you could still find it.

The only way to truly remove it is for the author to rewrite the repo using git-filter-branch or something to completely remove it and then push the new HEAD to GitHub. That would mean that others who "git pull" from that repo get the new, overwritten, repo instead of a simple commit, but in this case, where only one person pushes and all others pull, that would be acceptable.


This post by Marcel Grünauer was liked by: Bonobo
Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #19 Posted: Sat Aug 19, 2017 2:45 am 
Beginner

Posts: 1
Liked others: 0
Was liked: 0
Marcel Grünauer wrote:
The repo has been updated with the GoGoD Winter 2016 games, which is a copyright violation. I therefore recommend to delete this link.


You can delete GoGoD Winter 2016 games, and then re-collect them in another way, since the game itself has no copyright!

Top
 Profile  
 
Offline
 Post subject: Re: Welcome to Download the "computer go dataset" (160K SGFs
Post #20 Posted: Sat Aug 19, 2017 11:43 pm 
Lives in gote

Posts: 447
Location: Vienna, Austria
Liked others: 206
Was liked: 205
Luna wrote:
Marcel Grünauer wrote:
The repo has been updated with the GoGoD Winter 2016 games, which is a copyright violation. I therefore recommend to delete this link.


You can delete GoGoD Winter 2016 games, and then re-collect them in another way, since the game itself has no copyright!


We've had that discussion about the copyright of individual files vs collections several times, for example at viewtopic.php?f=10&t=14276 .


This post by Marcel Grünauer was liked by: Bonobo
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 21 posts ]  Go to page 1, 2  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group