It is currently Fri Apr 19, 2024 8:22 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 5 posts ] 
Author Message
Offline
 Post subject: Distributed neural network training?
Post #1 Posted: Sun Aug 20, 2017 9:16 am 
Dies in gote

Posts: 34
Liked others: 2
Was liked: 5
Rank: 3k
Will developers of go programs be interested in setting up a distributed computing project to train their neural networks, like Folding@home and BOINC? That way millions of go fans worldwide can contribute to making go programs stronger.

Top
 Profile  
 
Offline
 Post subject: Re: Distributed neural network training?
Post #2 Posted: Sun Aug 20, 2017 9:52 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Someone asked GCP (author of Leela) about this as he said his lack of computer power for training the networks (and generating self-play training data) was a major thing holding back Leela's strength. However he explained that you need a very fat data pipe between compute units so you can't effectively distribute a task for one beefy machine with several high end GPUs down to 20 low end laptops. However [my interpretation] if there are people with high spec gaming machines with a few Titan Xs then perhaps they could usefully contribute. I don't know how common that is.


This post by Uberdude was liked by: Cyan
Top
 Profile  
 
Offline
 Post subject: Re: Distributed neural network training?
Post #3 Posted: Mon Aug 21, 2017 6:59 am 
Beginner

Posts: 13
Liked others: 1
Was liked: 3
I think architecture like Folding@home is suitable to generate millions of self-play game, rather than training neural network.


This post by zakki was liked by: Satorian
Top
 Profile  
 
Offline
 Post subject: Re: Distributed neural network training?
Post #4 Posted: Mon Aug 21, 2017 12:24 pm 
Dies in gote

Posts: 34
Liked others: 2
Was liked: 5
Rank: 3k
zakki wrote:
I think architecture like Folding@home is suitable to generate millions of self-play game, rather than training neural network.

Would that be useful for current programs like Rayn?

Top
 Profile  
 
Offline
 Post subject: Re: Distributed neural network training?
Post #5 Posted: Tue Aug 22, 2017 5:16 am 
Beginner

Posts: 13
Liked others: 1
Was liked: 3
AlphaGo uses 30000000 games.
But now 1600000 human games without random moves and 1440000 aya games with random move are available.
Rayn (and other programs) needs high quality 10x amount of games.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 5 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group