It is currently Fri Apr 19, 2024 10:37 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 19 posts ] 
Author Message
Offline
 Post subject: Downloadable trained neural net for Go
Post #1 Posted: Sun Apr 10, 2016 2:19 pm 
Dies with sente

Posts: 83
Liked others: 6
Was liked: 65
Rank: now 1kyu-ish
There is a website that allows you to play Go against a deep neural network - all implemented in javascript. The website is powered by jgoboard and the ConvNetjs libraries.

Their trained downloadable neural net for Go is available, which might be of interest to some.It was trained on GoGoD games

"This neural net was trained to make moves similar to the moves made by professional players in a dataset of over 80,000 professional Go games."

https://chrisc36.github.io/deep-go/

Everything is written in javascript, runs in the browser and uses CPUs <not GPUs> - which keeps things simple.

The paper that describes all this was written by Amos Storkey (Edinburgh University) and Christopher Clark (Allen Institue for Artificial Intelligence) - presented in 2015 - on training Deep Convolutional Neural Networks to Play Go.

There is a good intro to Deep Learning on the ConvNetjs page


This post by John Tilley was liked by 3 people: Bonobo, ez4u, Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #2 Posted: Mon Apr 11, 2016 3:56 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
If you implement these "shape" moves that this NN provides into MCTS so it doesn't pick random moves but moves suggested by NN you get something similar to Alphago?

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #3 Posted: Mon Apr 11, 2016 4:00 am 
Lives with ko

Posts: 199
Liked others: 6
Was liked: 55
Rank: KGS 3 kyu
You would be 2/3 of the way, you also need the value network.

(AlphaGo also used 2 distinct policy networks, one fast (less accurate) and one slow (more accurate).)

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #4 Posted: Mon Apr 11, 2016 4:59 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Krama wrote:
If you implement these "shape" moves that this NN provides into MCTS so it doesn't pick random moves but moves suggested by NN you get something similar to Alphago?

Nope, you would get something similar to the latest versions of Zen, Crazystone, Aya, etc which are MCTS bots which have recently added Neural Nets, or darkforest (from Facebook) which has always used neural nets.

uPWarrior wrote:
You would be 2/3 of the way, you also need the value network.

It's worth adding that that missing third is the hardest and most innovative part of AlphaGo. There was this nice chart from the AlphaGo paper (Fan Hui version, it's gotten stronger since) showing the strengths using various combinations of the components:
Attachment:
AlphaGo components.png
AlphaGo components.png [ 14.22 KiB | Viewed 11555 times ]

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #5 Posted: Mon Apr 11, 2016 5:02 am 
Lives in sente

Posts: 923
Location: UK
Liked others: 72
Was liked: 479
Rank: 5 dan
KGS: macelee
This program plays beautiful opening, definitely better than shodan level. It is rather weak in mid-game which is to be expected.

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #6 Posted: Mon Apr 11, 2016 5:47 am 
Lives with ko

Posts: 199
Liked others: 6
Was liked: 55
Rank: KGS 3 kyu
Uberdude wrote:
It's worth adding that that missing third is the hardest and most innovative part of AlphaGo.


Definitely. I think it is not only the hardest to conceptually figure out how to obtain (the RL idea was great), but also the hardest to implement without proper hardware.

On the other hand, it requires the previous building blocks to be in place, so it is nice that there is an open source effort moving forward.

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #7 Posted: Mon Apr 11, 2016 6:54 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 180
Since people are probably interested in the development of a NN program that does not require much in the way of resources, we perhaps should be opening a thread to talk about Julie (which just appeared on the scene). OK, not a very strong player in the machine tournament. But it would be good if we had some information about how it might do against some of us not so strong humans. The reason is that it appears to be able to run fast on very modest hardware.

So yes it got beat by most the other programs there, but considering the minimal hardware and the minimal time it used, able to do what it did with more than two orders of magnitude less resources.

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #8 Posted: Mon Apr 11, 2016 7:19 am 
Lives in gote

Posts: 677
Liked others: 6
Was liked: 31
KGS: 2d
macelee wrote:
This program plays beautiful opening, definitely better than shodan level. It is rather weak in mid-game which is to be expected.


I played it (with Black), won relatively easily and I estimate it at 1k-level. I think with a little bit of work (like how to pass or resign) this could become the best free-available bot. And with a little bit more work this could become the best free available 4-5d Bot.


Attachments:
test.jpg
test.jpg [ 94.62 KiB | Viewed 11505 times ]
Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #9 Posted: Mon Apr 11, 2016 7:33 am 
Lives in sente

Posts: 923
Location: UK
Liked others: 72
Was liked: 479
Rank: 5 dan
KGS: macelee
Pippen wrote:
macelee wrote:
This program plays beautiful opening, definitely better than shodan level. It is rather weak in mid-game which is to be expected.


I played it (with Black), won relatively easily and I estimate it at 1k-level. I think with a little bit of work (like how to pass or resign) this could become the best free-available bot. And with a little bit more work this could become the best free available 4-5d Bot.


Agreed. Combine it with a reasonable 'score estimator' type of code so that it knows when to resign. Should be quite easy.

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #10 Posted: Mon Apr 11, 2016 7:42 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
Pippen wrote:
macelee wrote:
This program plays beautiful opening, definitely better than shodan level. It is rather weak in mid-game which is to be expected.


I played it (with Black), won relatively easily and I estimate it at 1k-level. I think with a little bit of work (like how to pass or resign) this could become the best free-available bot. And with a little bit more work this could become the best free available 4-5d Bot.


Try to disable auto move and show analysis of the moves then play on your own against someone else and use the moves it suggests. However if it suggests a blunder type of move then you play a move you think is correct.


This post by Krama was liked by: macelee
Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #11 Posted: Mon Apr 11, 2016 7:47 am 
Judan
User avatar

Posts: 5539
Location: Banbeck Vale
Liked others: 1103
Was liked: 1456
Rank: 1D AGA
GD Posts: 1512
Kaya handle: Test
macelee wrote:
...It is rather weak in mid-game...


Exceptionally so. I tried playing it and after about 100 to 150 moves it starts giving away groups.

_________________
Help make L19 more organized. Make an index: https://lifein19x19.com/viewtopic.php?f=14&t=5207

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #12 Posted: Mon Apr 11, 2016 10:37 am 
Lives with ko

Posts: 163
Liked others: 19
Was liked: 32
Very nice. I needed an undo in a corner. At the end though, it started to make pointless moves. And at some stage claimed that suicide isn't allowed (I think it tried to suicide itself) and switched colours. That's a fine tesuji, indeed. Is there a way to score or is this no-pass go?

_________________
If something sank it might be a treasure. And 2kyu advice is not necessarily Dan repertoire..

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #13 Posted: Mon Apr 11, 2016 11:31 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
I started off with a common opening pattern of the fighting Chinese and it copied standard play for a while, but when I started a semeai in a corner it got confused and even after it was my 3 libs to its 2, it continued surrounding one of the outside groups (which was eyeless with about 7 libs but alive due to the semeai) whilst I proceeded to claim the rest of the board and win by loads. It also amusingly made the following local mistake (which some MCTS should fix):

Click Here To Show Diagram Code
[go]$$B
$$ . O . . |
$$ . O 3 . |
$$ . X O 2 |
$$ , X O 1 |
$$ X O X . |
$$ X O X . |
$$ . . . . |
$$ --------+[/go]

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #14 Posted: Tue Apr 12, 2016 8:27 am 
Lives with ko

Posts: 271
Location: Hong Kong
Liked others: 2
Was liked: 49
Rank: IGS 7d
IGS: goeye
Kill all stones of the AI in sente :)


Attachments:
Screen Shot 2016-04-12 at 11.25.53 PM.png
Screen Shot 2016-04-12 at 11.25.53 PM.png [ 407.87 KiB | Viewed 11354 times ]
Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #15 Posted: Tue Apr 12, 2016 11:31 am 
Beginner

Posts: 12
Liked others: 1
Was liked: 4
Rank: 12k KGS or 15k DGS
KGS: wauske
DGS: wauske
Online playing schedule: 20:00-22:00 CET
Well, you guys are a lot stronger than I am so I have yet to win :clap:

Luckily I am a lot more tech-savvy than I am a Go player. I noticed that the site only offered the net.js as a download, not the other pre-requisite files. So, I downloaded them in their original format and zipped it. For those wanting to play with it offline or on their own (private) webspace, here is the download link: http://millsf.home.xs4all.nl/Deepgo.zip

This is a direct, 1-on-1 download of the page. All credit goes to its creator.

To use it: unzip it to any directory and open the index.html (Chrome or Edge work fine, IE11 doesn't). I also uploaded it to a private webserver which works too.

I'll also ask the owner for permission, should he decide not to grant it I'll remove the link right away.


This post by wauske was liked by 2 people: Bonobo, macelee
Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #16 Posted: Wed Apr 13, 2016 4:05 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
I noticed it can't read out ladders so you might want to play a ladder breaker and win :)

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #17 Posted: Fri May 20, 2016 7:56 am 
Beginner

Posts: 12
Liked others: 1
Was liked: 4
Rank: 12k KGS or 15k DGS
KGS: wauske
DGS: wauske
Online playing schedule: 20:00-22:00 CET
wauske wrote:
Well, you guys are a lot stronger than I am so I have yet to win :clap:

Luckily I am a lot more tech-savvy than I am a Go player. I noticed that the site only offered the net.js as a download, not the other pre-requisite files. So, I downloaded them in their original format and zipped it. For those wanting to play with it offline or on their own (private) webspace, here is the download link: http://millsf.home.xs4all.nl/Deepgo.zip

This is a direct, 1-on-1 download of the page. All credit goes to its creator.

To use it: unzip it to any directory and open the index.html (Chrome or Edge work fine, IE11 doesn't). I also uploaded it to a private webserver which works too.

I'll also ask the owner for permission, should he decide not to grant it I'll remove the link right away.


Download has been updated.
Added functionality is that when opening the website on an Android Phone with Chrome 39 or newer you can choose "Add to home screen" from the menu. As far as I know this only works when running from webspace and not from internal storage but i haven't tried running it from internal storage.
The website will then behave like an app and appears to stay in memory longer which means you can open other apps and return to the DCNN without losing your game.

This is mostly experimental and I won't vouch for it working on every Android Phone but it works on my Moto X but doesn't from my Galaxy Tab 2 my guess would be that memory is the cuplprit.

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #18 Posted: Fri May 20, 2016 10:08 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
Would someone be willing to take any free go software that is open sourced and embed this neural network to it's MCTS?

I am wondering how strong can such a basic thing become.

Top
 Profile  
 
Offline
 Post subject: Re: Downloadable trained neural net for Go
Post #19 Posted: Fri May 20, 2016 11:26 am 
Lives in gote

Posts: 653
Location: Austin, Texas, USA
Liked others: 54
Was liked: 216
Krama wrote:
Would someone be willing to take any free go software that is open sourced and embed this neural network to it's MCTS?

I am wondering how strong can such a basic thing become.


Someone already added some limited DCNN capability to Pachi -- only the root node. Pasky is not actively developing Pachi anymore but he is supporting pull requests.

https://github.com/pasky/pachi/pull/28

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 19 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group