It is currently Fri May 24, 2019 4:23 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 266 posts ]  Go to page Previous  1 ... 9, 10, 11, 12, 13, 14  Next
Author Message
Offline
 Post subject: Re: Engine Tournament
Post #221 Posted: Thu May 31, 2018 8:30 am 
Lives with ko

Posts: 156
Liked others: 15
Was liked: 23
Rank: Beginner
pnprog wrote:
I will be surprised if Zen can score 14 wins.


Against the CPU version of Leela Zero with different networks?

I think I'll keep my results private in the future. This discussions take more time than to play the games.

Bye

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #222 Posted: Sat Jun 02, 2018 12:08 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
Last version of Pachi became weaker (details).

_________________
Go engines start up parameters.
Sparring games of Go engines
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions in Russian)
Additional soft, required by some Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #223 Posted: Mon Jun 11, 2018 12:51 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
Last version of Ray became a bit stronger (details).
The rating of available for usual users Go engines without GPU support is next:

Highest level
1. Leela;

High level
2. Hiratuka;

Middle level
3. Pachi_DCNN;
4. Ray;
5. Pachi;
6. MoGo.

_________________
Go engines start up parameters.
Sparring games of Go engines
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions in Russian)
Additional soft, required by some Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #224 Posted: Sat Jun 23, 2018 2:01 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
I had sparred last version of Ray with other this level engines (details).
The rating of available for usual users Go engines without GPU support is next:

Highest level
1. Leela;

High level
2. Hiratuka;

Middle level
3. Pachi_DCNN;
4&5. Ray & Pachi;
6. MoGo.

_________________
Go engines start up parameters.
Sparring games of Go engines
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions in Russian)
Additional soft, required by some Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #225 Posted: Sat Jun 30, 2018 2:07 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
I had tested LeelaZero (details).
The rating of Go engines without using GPU is next:

Super level
1. LeelaZero;

Highest level
2. Leela;

High level
3. Hiratuka;

Middle level
4. Pachi_DCNN;
5&6. Ray & Pachi;
7. MoGo.

_________________
Go engines start up parameters.
Sparring games of Go engines
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions in Russian)
Additional soft, required by some Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #226 Posted: Sat Jul 07, 2018 1:10 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
I had tested different LeelaZero versions with different weights details.
The rating of Go engines without using GPU is next:

Super level
1. LeelaZero;

Highest level
2. Leela;

High level
3. Hiratuka;

Middle level
4. Pachi_DCNN;
5&6. Ray & Pachi;
7. MoGo.

_________________
Go engines start up parameters.
Sparring games of Go engines
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions in Russian)
Additional soft, required by some Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #227 Posted: Sat Aug 18, 2018 3:10 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
LeelaZero 0.14 is a bit stronger (not as much, as in case of Phoenix), than 0.15 (details)...

_________________
Go engines start up parameters.
Sparring games of Go engines
Go board with attached strong engines on few strength levels from random to "God-like" playing (instructions in Russian)
Additional soft, required by some Go engines

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #228 Posted: Sun Aug 19, 2018 10:41 am 
Lives with ko

Posts: 156
Liked others: 15
Was liked: 23
Rank: Beginner
q30 wrote:
LeelaZero 0.14 is a bit stronger (not as much, as in case of Phoenix), than 0.15 (details)...


My Russian is a little bit rusty. Do you seriously try to tell us v0.14 is better than v0.15 based on 6 games?

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #229 Posted: Sat Aug 25, 2018 10:31 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
v. 0.15 seriously is not better, than v. 0.14, and most likely weaker in case of Phoenix...

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #230 Posted: Sat Aug 25, 2018 11:29 am 
Lives with ko

Posts: 156
Liked others: 15
Was liked: 23
Rank: Beginner
q30 wrote:
v. 0.15 seriously is not better, than v. 0.14, and most likely weaker in case of Phoenix...


Look at the changelog, it is no surprise that v0.15 is not stronger than v0.14. There are only changes for training games. Beside that it is ridiculous to draw conclusions from a 6 game match. There is a reason why the Leela Team does 400 game matches and requires a 55% score for the promotion of a network.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #231 Posted: Sat Sep 01, 2018 8:10 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
In these results 0.14 wins 0.15 by black and by white. The proximity to 50 % may explained by very small time control...
And what about Phoenix?

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #232 Posted: Sun Sep 02, 2018 3:19 am 
Lives with ko

Posts: 156
Liked others: 15
Was liked: 23
Rank: Beginner
q30 wrote:
In these results 0.14 wins 0.15 by black and by white. The proximity to 50 % may explained by very small time control...


51% winrate says nothing.

And if you play a match between two engines of the same strength the timecontrol doesn't matter. The chance of winning is 50%, no matter if you play with 1 visit, 100000 visits or with a rolling dice. You still don't understand mathematical basics.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #233 Posted: Sun Sep 02, 2018 3:51 am 
Judan

Posts: 5808
Location: Cambridge, UK
Liked others: 328
Was liked: 3106
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
Are you trying to find the affect of the Leela Zero engine version on the strength of the bot? Whilst it could make some difference if there are algorithmic changes or parameters tuned, most of the difference will come from the version of the weights used.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #234 Posted: Tue Sep 04, 2018 9:15 am 
Lives with ko

Posts: 156
Liked others: 15
Was liked: 23
Rank: Beginner
q30 wrote:
And what about Phoenix?


v0.14 doesn't even support the Phoenix network.

There was a hack of v0.14 that supported Phoenix networks, but it wasn't working correctly afaik.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #235 Posted: Sat Sep 08, 2018 4:02 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
as0770 wrote:
q30 wrote:
In these results 0.14 wins 0.15 by black and by white. The proximity to 50 % may explained by very small time control...


51% winrate says nothing.

And if you play a match between two engines of the same strength the timecontrol doesn't matter. The chance of winning is 50%, no matter if you play with 1 visit, 100000 visits or with a rolling dice. You still don't understand mathematical basics.

You still don't understand mathematical basics: if time control -> 0, than game of any (except pattern) engine -> to absolutely random and, respectively, the result of sparring -> 50%:50% nevertheless of engines strength...

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #236 Posted: Sat Sep 08, 2018 4:55 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
Uberdude wrote:
Are you trying to find the affect of the Leela Zero engine version on the strength of the bot? Whilst it could make some difference if there are algorithmic changes or parameters tuned, most of the difference will come from the version of the weights used.

It may depend on code productivity, i.e. it may was appended some time waste in new version...


Last edited by q30 on Sat Sep 08, 2018 10:13 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #237 Posted: Sat Sep 08, 2018 5:02 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
as0770 wrote:
q30 wrote:
And what about Phoenix?


v0.14 doesn't even support the Phoenix network.

There was a hack of v0.14 that supported Phoenix networks, but it wasn't working correctly afaik.

See here. The file of weight is the same...

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #238 Posted: Sat Sep 08, 2018 2:14 pm 
Lives with ko

Posts: 156
Liked others: 15
Was liked: 23
Rank: Beginner
q30 wrote:
You still don't understand mathematical basics: if time control -> 0, than game of any (except pattern) engine -> to absolutely random and, respectively, the result of sparring -> 50%:50% nevertheless of engines strength...


You are riding a dead horse and make a fool out of yourself.

Leela with time=0 or visit=1 is far away from playing random. Try to win a game against it. And playing one engine against itself will result in a 50% winning chance regardless the time control. I don't know why I even have to discuss this basics again and again.

q30 wrote:
See here. The file of weight is the same...


Sometimes I wonder if you just want to fool us, but in the meantime I think you just don't understand English well enough to get the points. But in this case you should reconsider if you want to do this kind of discussions here.

Yes, the network is the same, but v.14 just can't handle it and the hack of v0.14 didn't handle it correctly.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #239 Posted: Sat Sep 15, 2018 12:20 am 
Dies with sente

Posts: 75
Liked others: 1
Was liked: 1
Rank: 30 kyu
I don't know English well, so I'll try to answer on that I understood (and how I understood).
Yes, if AI Leela has pattern like play in case of time -> 0, than it will be not random, but will the same sequence (with the same weight file). So with the same weight file sparring of different Leela versions will -> 50%:50%. And playing one engine (version) against itself will result in a 50% winning chance regardless the time control only in case of using the same weight file...

I don't know, what You mean under 'v.14 just can't handle it and the hack of v0.14 didn't handle it correctly', but the versions 0.14 and 0.15 by link above (i.e. of Leela Phoenix) are playing with the weight file by the same link...

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #240 Posted: Sat Sep 15, 2018 4:33 am 
Lives with ko

Posts: 156
Liked others: 15
Was liked: 23
Rank: Beginner
q30 wrote:
50% winning chance regardless the time control only in case of using the same weight file...


Or a weight file of similar strength. And once again: If one engine scores 55% in a 400 game match, there is still a chance of 1% that it is _not_ stronger.

q30 wrote:
I don't know, what You mean under 'v.14 just can't handle it and the hack of v0.14 didn't handle it correctly', but the versions 0.14 and 0.15 by link above (i.e. of Leela Phoenix) are playing with the weight file by the same link...


Your link points to LeelaZero_PhoenixGo v1 and v2 but you were talking about Leela Zero v0.14 and 0.15. LeelaZero 0.14 don't support Phoenix networks. Results of LeelaZero_PhoenixGo v1 vs. LeelaZero_PhoenixGo v2 with Phoeniox Networks don't say anything about the strength of LeelaZero v0.14 and 0.15. I wouldn't even trust results with Leela networks.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 266 posts ]  Go to page Previous  1 ... 9, 10, 11, 12, 13, 14  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Vesa and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group