It is currently Thu Mar 28, 2024 9:21 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 127 posts ]  Go to page Previous  1 ... 3, 4, 5, 6, 7  Next
Author Message
Offline
 Post subject: Re: Leela has a new version
Post #101 Posted: Mon Feb 27, 2017 11:14 am 
Lives in sente

Posts: 727
Liked others: 44
Was liked: 218
GD Posts: 10
Looking forward to leela-0.9.2-4c performance in cgos.
Maybe we have to wait until v.1.0 for public release.

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #102 Posted: Sat Mar 04, 2017 2:39 pm 
Beginner

Posts: 8
Liked others: 0
Was liked: 2
Rank: 5k


There was an interesting game today on KGS between Ilya Shikshin and Leela.
In fact Leela seemed to be ahead and in control during the whole game but it miserably failed a few moves before the end and resigned there.

The position that interests us really begins at move 188 but the climax is move 191. D17

When analysing the game with my home version 0.9.0, I noticed that in every variation displayed by Leela before this move, then D17 was systematically assumed to be answered by E17, so that an eventual ko at Q19 could be handled.

As we can see at move 191. from this screenshot, Leela only considers 3 potential answers and still estimates his chances of success very high :

Image

But Ilya played next 192. M19 and Leela realized this was hopeless and winning % droped from 70% to less than 10% !

I ran the position in various engines, Zen 9.7 is also overseeing this move for 30s before it appears effectively in its candidates move list and almost immediately realizes that it is a dreadful threat. Surprisingly the 'allmighty' Fuego plays M19 blindly and instantly.

I was wondering how such powerful engines not only cannot see this immediately but do not even consider a move as important as an atari onto a big group ?! I let Leela run for more than 5 minutes, and it never considered candidates moves other than the 3 above.

For engines to oversee a threat because it is behinf the search horizon is a thing, but to not even assess a potential atari seems quite a big flaw in the design.

What do you think ? Are you able to reproduce this on other versions of Leela ?

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #103 Posted: Sun Mar 05, 2017 7:23 am 
Lives with ko
User avatar

Posts: 284
Liked others: 94
Was liked: 153
Rank: OGS 7 kyu
Hi,

I just followed your link from my other thread.
Quote:
Surprisingly the 'allmighty' Fuego plays M19 blindly and instantly.
In fact, even the venerable GnuGo would play M19

Quote:
Are you able to reproduce this on other versions of Leela ?
Same issue with Leela 6.2

_________________
I am the author of GoReviewPartner, a small software aimed at assisting reviewing a game of Go. Give it a try!

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #104 Posted: Sun Mar 05, 2017 11:51 am 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
zwim wrote:

But Ilya played next 192. M19 and Leela realized this was hopeless and winning % droped from 70% to less than 10% !



After viewed the games with Haylee, I observed similar behaviors of Leela. It has a strong tendency to follow wherever the opponent plays locally. Unlike zen, it doesn't play save (defensively) even when it is far ahead. So after battles around the board from here to there, it will forget what the most important move is globally.


This post by splee99 was liked by: nasdaq
Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #105 Posted: Thu May 18, 2017 7:00 pm 
Lives in sente

Posts: 727
Liked others: 44
Was liked: 218
GD Posts: 10
Leela 0.10.0 is available for download. (I kinda hope they'd name this 1.0 instead)


This post by pookpooi was liked by 3 people: Bonobo, ez4u, Waylon
Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #106 Posted: Sat May 20, 2017 12:20 am 
Beginner

Posts: 1
Liked others: 0
Was liked: 0
Rank: EGF 11 kyu
Does anybody know how strong Leela is on older computers? I have Xeon X5460 3,16GHz, 16GB RAM, GF GTX760 and today I won against 1 dan twice. (Leela 0.9.0, rated game 6 handi, 19x19 I've tried GPU and CPU also). I'm 11 kyu EGF by the way. Engine settings are all ticked.

Thank you.

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #107 Posted: Sat May 20, 2017 8:32 am 
Lives with ko

Posts: 180
Liked others: 15
Was liked: 23
Rank: Beginner
pookpooi wrote:
Leela 0.10.0 is available for download. (I kinda hope they'd name this 1.0 instead)



I think the 1.0 will be commercial. So I am fine with 0.10 :)

Nice to see a Linux version of the UI!

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #108 Posted: Sun May 21, 2017 2:47 am 
Lives with ko

Posts: 131
Liked others: 0
Was liked: 7
Leela 0.10.0 is SUPERB :D

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #109 Posted: Mon May 22, 2017 5:12 am 
Lives in gote

Posts: 676
Liked others: 6
Was liked: 31
KGS: 2d
goame wrote:
Leela 0.10.0 is SUPERB :D


I dunno, it looks weak, just played a game, look for yourself, White (Leela) needs to be able to bring a game like that home.


Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #110 Posted: Mon May 22, 2017 6:26 am 
Lives in gote

Posts: 676
Liked others: 6
Was liked: 31
KGS: 2d
Marcel Grünauer wrote:
What happened from move 251 onwards? I could understand the software making useless moves after all the neutral points have been played, but Black?


I wanted to check if and when Leela resigns, so I played useless moves as well. Again: From this game I'd give Leela 1k or 2k strength. No dan player would lose a game like that after capturing a bulk of black stones. Such a player would just simplify the game and take it home.

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #111 Posted: Tue May 23, 2017 7:01 am 
Lives in gote

Posts: 436
Liked others: 1
Was liked: 38
Rank: KGS 5 kyu
Pippen wrote:
Marcel Grünauer wrote:
What happened from move 251 onwards? I could understand the software making useless moves after all the neutral points have been played, but Black?


I wanted to check if and when Leela resigns, so I played useless moves as well. Again: From this game I'd give Leela 1k or 2k strength. No dan player would lose a game like that after capturing a bulk of black stones. Such a player would just simplify the game and take it home.


What is your hardware, cpu and gpu and did you use gpu version.
Also did you put it on maximum simulations?

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #112 Posted: Tue May 23, 2017 7:25 am 
Gosei

Posts: 1590
Liked others: 886
Was liked: 527
Rank: AGA 3k Fox 3d
GD Posts: 61
KGS: dfan
There is some interesting discussion of the tactical issues with Leela 0.10 on the computer-go mailing list, including the author, in the thread "mini-max with Policy and Value network" at http://computer-go.org/pipermail/comput ... hread.html (in particular, start with Marc Landgraf's posts).


This post by dfan was liked by: Bill Spight
Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #113 Posted: Tue May 23, 2017 2:16 pm 
Dies in gote

Posts: 46
Liked others: 109
Was liked: 34
Rank: Euro 1 dan
GD Posts: 7
If you are playing 'rated' games with leela, I think it adjusts it's playing strength to your assumed rating. Then it's no wonder it does funny things.

To make it play strongly, select 'new game', unimited playouts, and then adjust the clock in the menu so that it has enough time. The window will show the number of nodes (in the MCTS tree? I'm not sure). I don't know how many nodes it needs it needs to be e.g. 6d, but that would be interesting to know.

I gave it 30 min on my 4-core laptop and lost, as euro 1 dan, taking 4 handi. I think the number of nodes it showed were typically upwards of 100k.


This post by zermelo was liked by: Waylon
Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #114 Posted: Sun May 28, 2017 3:33 am 
Lives with ko

Posts: 131
Liked others: 0
Was liked: 7
I'm still waiting for Leela on iOS.

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #115 Posted: Sat Jun 10, 2017 5:16 pm 
Beginner

Posts: 1
Liked others: 0
Was liked: 0
Universal go server handle: lighght
Is anyone else having trouble getting the openCL version to run properly on macOS? The CPU-only version is running five to ten times faster than the openCL version on my machine. I've verified that Leela's detected my discrete GPU (The "About" window says "OpenCL: Geforce GT 650M @ 900 MHz), and I've verified that my drivers are up to date.

This is 0.10.0 running on macOS Sierra 10.12.5.

Even the non-GPU version is incredible, hitting 100k nodes in about 25 seconds on my extremely dated machine. I'm just very keen to see what Leela can do once she's tapped into all my hardware. :geek:

EDIT: Just noticed that this is only the case when "use neural network" is checked. When neither Leela nor Leela-openCL are using neural networks, Leela-openCL is much faster. But when they're both using neural networks, non-openCL Leela is way faster. :scratch:

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #116 Posted: Sat Jul 01, 2017 6:28 am 
Lives in gote

Posts: 418
Liked others: 9
Was liked: 83
Rank: kgs 5 kyu
KGS: Pio2001
Hi,
I've used Leela to make my first game analyze.

The software is extremely useful ! It showed me many vital points that I didn't see.

I'm not yet comfortable with the exploration of variations, since there is no tree view, like the one in CGoban.

For the time being, if I want to try a variation from a recorded game while the analysis is running, I click "Remember this position on the stack", then play some moves, using the "take back one move" button to change variations. Leela remembers all the MC calculations that it already made.
When I'm done, I click the "revert to stored position" button, and I can go on with the game.

There is a little bug. If I open a game and start the analysis, when I click "Remember this position on the stack" to remember to position and try some variations, when I click on the "revert to stored position" button, the analysis engine goes on analyzing the older position, that is no longer displayed. I have to go back one move and go forward one move to force the reload of the current position into the analysis tool.

If the variation that I explored is in the list, then its evaluation takes into account the analyzes done during the variation explorations. That's the way I force Leela to evaluate some moves that it doesn't.

For example if there are 3 favorite moves with 10000 iterations each, then another one with a higher winning probability, but only 10 iterations, and just one follow up, this 4th move can be ignored for minutes.
So I click "+", play the move, let the analyze explore 10000 iterations, then I "revert to stored position", "take back one move", "go forward one move" (to reload the current position).
Now, the 4th move has 10000 iterations done, and the subsequent variations are stored too. :cool:

Near the end of the game, I also noticed some oddities.

Attachment:
Pio2001_20170629_Leela_2.png
Pio2001_20170629_Leela_2.png [ 73.48 KiB | Viewed 12115 times ]


Here, move 219 is a blunder where a whole group changes from "alive" to "ko". The neural network (red curve) seems much better at finding vital points than the Monte-Carlo (blue curve).

On the opposite, it seems to me that the MC curve is more reliable at estimating the winner during the late endgame, when only small endgame move remains, than the neural network, but in this situation, Leela didn't see the possibility of seki, so I can't be sure yet.

Which brings me to the topic of scoring.
At the end of the game, how can I inform Leela that a position is seki ?
If I'm not mistaken, the bottom left group is the attached position is in dual life, but Leela scores it as dead, and I can't change that :-?

Attachment:
Seki.png
Seki.png [ 180.22 KiB | Viewed 12115 times ]

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #117 Posted: Sun Jul 23, 2017 5:16 am 
Dies in gote

Posts: 34
Liked others: 2
Was liked: 5
Rank: 3k
Leela 0.15.0 started playing on CGOS, currently winning 15 out of 15 games!

http://www.yss-aya.com/cgos/19x19/cross ... .15.0.html


Last edited by Cyan on Sun Jul 23, 2017 9:51 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #118 Posted: Sun Jul 23, 2017 8:07 am 
Lives in gote

Posts: 676
Liked others: 6
Was liked: 31
KGS: 2d
I hope for a self-play-mode in the next versions.

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #119 Posted: Sun Jul 23, 2017 12:32 pm 
Dies in gote

Posts: 34
Liked others: 2
Was liked: 5
Rank: 3k
Leela's 20 game win streak has finally been ended by Zen, after it lost a ko. Leela seems to be much stronger at life and death compared to version 0.10.0.

Top
 Profile  
 
Offline
 Post subject: Re: Leela has a new version
Post #120 Posted: Sun Jul 23, 2017 3:24 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
What is the version currently playing on Tygem? It seems to be quite annoying sometimes that it doesn't resign even when it is far behind.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 127 posts ]  Go to page Previous  1 ... 3, 4, 5, 6, 7  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group