It is currently Thu Apr 18, 2024 8:35 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 3 posts ] 
Author Message
Offline
 Post subject: End of Leela Zero Development January 31 2020?
Post #1 Posted: Tue Dec 17, 2019 3:59 pm 
Oza
User avatar

Posts: 2401
Location: Tokyo, Japan
Liked others: 2339
Was liked: 1332
Rank: Jp 6 dan
KGS: ez4u
Everyone interested in LZ should be aware of this topic under discussion in the project.

gcp posted the following a few hours ago.

Hi all,

there's 500k games now without a network promoting. This means the training window is "full". I increased it to 750k games, and did a last learning rate lowering (0.00001 @ bs=96). If this doesn't result in a promotion, we've pretty much reached the end of the first training run, after just over 2 years.

As I stated before, I don't have enough time nor energy to contribute any more (Leela Zero was very successful and achieved much more than I set out for, but it also ate a lot of my time especially the first year...) so I will not set up a second training run myself. There's many options to go from here, from someone picking and choosing the most promising improvements that have been proposed here and elsewhere to do a Leela Zero 2.0, to joining the community behind one of the other initiatives that built upon what we started (obviously SAI, but I heard KataGo is considering setting up a distributed effort as well).

I plan to keep the training server running until the 31st of January (if necessary bumping the playout count to add some more high quality data to the pool). If the last learning rate drop miraculously sends us improving again, I can extend that, but for now I would say that the community should probably plan its next steps with that date in mind.

_________________
Dave Sigaty
"Short-lived are both the praiser and the praised, and rememberer and the remembered..."
- Marcus Aurelius; Meditations, VIII 21

Top
 Profile  
 
Offline
 Post subject: Re: End of Leela Zero Development January 31 2020?
Post #2 Posted: Wed Dec 18, 2019 1:39 am 
Lives with ko

Posts: 131
Liked others: 0
Was liked: 7
"Hi all,

there's 500k games now without a network promoting. This means the training window is "full"."

Of course it's full, because every net size has a strength limit.
This is reached after net size ... is (perfectly) trained.

Now it's time to go for a bigger net size:)

Top
 Profile  
 
Offline
 Post subject: Re: End of Leela Zero Development January 31 2020?
Post #3 Posted: Sun Dec 22, 2019 12:29 pm 
Tengen

Posts: 4380
Location: North Carolina
Liked others: 499
Was liked: 733
Rank: AGA 3k
GD Posts: 65
OGS: Hyperpape 4k
There are now three new networks, though I don't have any idea of what that means for the big picture.

_________________
Occupy Babel!

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 3 posts ] 

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Bing [Bot] and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group