Engine Tournament

For discussing go computing, software announcements, etc.
q30
Lives with ko
Posts: 145
Joined: Sat Aug 13, 2016 8:23 am
Rank: 30 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 1 time

Re: Engine Tournament

Post by q30 »

With new version of Leela the rate is the same:
League A
1. Leela

League B
2. Ray
3. Pachi
4. MoGo

Leela 0.9.0 got stronger and, of course, remained the strongest Go engine (with GTP support). Is there any such engine, that can show at least slight resistance to Leela?

Go engines non default compiling and start up parameters.
leela_090_linux_x64 start up parameters: -g -t 2 -b 0 (with: gogui-twogtp.jar -verbose -komi 7.5 -time 1s+2/1)

Leela has new thinking process. For example, on GoGUI shell You can see: "Nodes: 248096, Win: 51.81% (MC:42.27%/VN:63.46%), PV: M8 M10 N9 N10 P9 P6",- where win percentage is now average of old Monte Carlo (MC) and some new VN algorithms. Leela's developer has selected non standard way for time control. In contrast to all other Go engines in Leela it's possible get only the time per move and only by subtraction from external application time per move setting the --lagbuffer (-b) parameter value. For example, if someone adds in GoGUI a few Leela's game strength levels, then he must start gogui.jar (excepting displaying the contestants elapsed times) with "-time 1s+21474836s/1" (for example - the maximal compensable by Leela's -b parameter) and add (in Menu/ Program/ New Program), for example, the next (with path to executive file leela_090_linux_x64 in Working directory):
1) ./leela_090_linux_x64 -g -b 2147483500
2) ./leela_090_linux_x64 -g -b 2147471600
3) ./leela_090_linux_x64 -g -b 0
(1 - for 1 sec per move; 2 - for 2 min per move; 3 - for 357914 min per move)

Engines. Games.
Shoreline
Dies in gote
Posts: 69
Joined: Mon Feb 20, 2017 1:15 am
Rank: DGS 9 kyu
GD Posts: 0
DGS: Shoreline
OGS: Shoreline
Location: Connecticut, USA
Been thanked: 5 times

Re: Engine Tournament

Post by Shoreline »

Hi all,

It is nice to read the old post here on these bots comparison.
I actually did similar things at end of 2016 and early 2017. I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Shoreline
as0770
Lives with ko
Posts: 180
Joined: Sun Jun 26, 2016 8:07 am
Rank: Beginner
GD Posts: 0
Has thanked: 15 times
Been thanked: 23 times

Re: Engine Tournament

Post by as0770 »

Shoreline wrote:Hi all,

It is nice to read the old post here on these bots comparison.
I actually did similar things at end of 2016 and early 2017. I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Shoreline


This executable works here on Ubuntu 16.04. Even the windows binary works with wine.
Shoreline
Dies in gote
Posts: 69
Joined: Mon Feb 20, 2017 1:15 am
Rank: DGS 9 kyu
GD Posts: 0
DGS: Shoreline
OGS: Shoreline
Location: Connecticut, USA
Been thanked: 5 times

Re: Engine Tournament

Post by Shoreline »

as0770 wrote:
Shoreline wrote:Hi all,

It is nice to read the old post here on these bots comparison.
I actually did similar things at end of 2016 and early 2017. I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Shoreline


This executable works here on Ubuntu 16.04. Even the windows binary works with wine.


Found the reason. This is 32 bits binary, does not work natively in 64 bits linux. By doing the compatible library installation, it trashed my virtual machine system.

Well, I will just have to give it up, not worth trying it out.
as0770
Lives with ko
Posts: 180
Joined: Sun Jun 26, 2016 8:07 am
Rank: Beginner
GD Posts: 0
Has thanked: 15 times
Been thanked: 23 times

Re: Engine Tournament

Post by as0770 »

Shoreline wrote:
as0770 wrote:
Shoreline wrote:Hi all,

It is nice to read the old post here on these bots comparison.
I actually did similar things at end of 2016 and early 2017. I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Shoreline


This executable works here on Ubuntu 16.04. Even the windows binary works with wine.


Found the reason. This is 32 bits binary, does not work natively in 64 bits linux. By doing the compatible library installation, it trashed my virtual machine system.

Well, I will just have to give it up, not worth trying it out.


My system is also 64 Bit. Anyway, Mogo is quite similar to Fuego :)
Shoreline
Dies in gote
Posts: 69
Joined: Mon Feb 20, 2017 1:15 am
Rank: DGS 9 kyu
GD Posts: 0
DGS: Shoreline
OGS: Shoreline
Location: Connecticut, USA
Been thanked: 5 times

Re: Engine Tournament

Post by Shoreline »

as0770 wrote:
Shoreline wrote:
Found the reason. This is 32 bits binary, does not work natively in 64 bits linux. By doing the compatible library installation, it trashed my virtual machine system.

Well, I will just have to give it up, not worth trying it out.


My system is also 64 Bit. Anyway, Mogo is quite similar to Fuego :)


Here is legacy inactive robot account at DGS using MoGo:
http://www.dragongoserver.net/userinfo.php?uid=44779

It needs 10 minutes per move set up in dual core computer and only achieved 8 kyu level at DGS by looking at the chart. Not sure your setup needs that kind of thinking time to be competitive. For fuego to achieve 5 kyu to 7 kyu at DGS, my redrobot at DGS only runs on a 10 seconds per move thinking time (default) in dual core linux computer. Here is redrobot at DGS:
http://www.dragongoserver.net/userinfo.php?uid=97563

It appears that on resource wise, and strength, MoGo is not very competitive compared to Fuego.
q30
Lives with ko
Posts: 145
Joined: Sat Aug 13, 2016 8:23 am
Rank: 30 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 1 time

Re: Engine Tournament

Post by q30 »

Shoreline wrote:I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Try from here.
You must have x86_64 version of Linux (elsewhere You must compile MoGo 4.86).
q30
Lives with ko
Posts: 145
Joined: Sat Aug 13, 2016 8:23 am
Rank: 30 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 1 time

Re: Engine Tournament

Post by q30 »

as0770 wrote:My system is also 64 Bit. Anyway, Mogo is quite similar to Fuego :)

MoGo (all versions) are stronger, than FueGo, and have a huge number of start up parameters (see link above).
q30
Lives with ko
Posts: 145
Joined: Sat Aug 13, 2016 8:23 am
Rank: 30 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 1 time

Re: Engine Tournament

Post by q30 »

Shoreline wrote:It appears that on resource wise, and strength, MoGo is not very competitive compared to Fuego.

See here games, including between MoGo and FueGo (all games are with the same PC resources given for each engine).
Shoreline
Dies in gote
Posts: 69
Joined: Mon Feb 20, 2017 1:15 am
Rank: DGS 9 kyu
GD Posts: 0
DGS: Shoreline
OGS: Shoreline
Location: Connecticut, USA
Been thanked: 5 times

Re: Engine Tournament

Post by Shoreline »

q30 wrote:
Shoreline wrote:I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Try from here.
You must have x86_64 version of Linux (elsewhere You must compile MoGo 4.86).


Thanks for providing MoGo X64 linux binary. Indeed, MoGo 4.86 in my machine can beat Fuego easily with similar thinking time and resource.
q30
Lives with ko
Posts: 145
Joined: Sat Aug 13, 2016 8:23 am
Rank: 30 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 1 time

Re: Engine Tournament

Post by q30 »

Shoreline wrote:Thanks for providing MoGo X64 linux binary. Indeed, MoGo 4.86 in my machine can beat Fuego easily with similar thinking time and resource.

All MoGo versions with parameters by link above beat FueGo too...
Moreover, in games by this link You can see, that MoGo versions can't beat unambiguously each other (even 32-bit version)...
q30
Lives with ko
Posts: 145
Joined: Sat Aug 13, 2016 8:23 am
Rank: 30 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 1 time

Re: Engine Tournament

Post by q30 »

Leela in version 0.10.0 became stronger and, of course, remains the strongest Go engine (at least among engines with GTP support). Details.
But it still has two disadvantages:
1) the time control;
2) very late resigning (for example, it wasn't resign with win percentage by VN 0,00% until by MC was >20%...)

With new version of Leela the rate is the same:
League A
1. Leela

League B
2. Ray
3. Pachi
4. MoGo

Go engines non default compiling and start up parameters.
leela_0100_linux_x64 start up parameters: -g -t 2 -b 0 (with: gogui-twogtp.jar -verbose -komi 7.5 -time 1s+2/1)


Engines. Games.
as0770
Lives with ko
Posts: 180
Joined: Sun Jun 26, 2016 8:07 am
Rank: Beginner
GD Posts: 0
Has thanked: 15 times
Been thanked: 23 times

Re: Engine Tournament

Post by as0770 »

Hi,

here is an Update with Leela 0.10.0, Mogo 4.86, Orego 7.08 and Matilda 1.24.

Leela 0.8.0 won 14-10 against Hiratuka, Leela 0.10.0 now wins by 16-0.

Leela vs. Hiratuka:

Code: Select all

    1. Leela 0.10.0                   16/16
    2. Hiratuka 10.37B                0/16


League A:

Code: Select all

    1. Leela 0.10.0                 28/28
    2. Hiratuka 10.37B              23/28
    3. PachiUCT 11.99               18/28
    4. Ray 8.0.1                    17/28
    5. Mogo 4.86                    13/28
    6. Fuego 1.1                     8/28
    7. Orego 7.08                    4/28
    8. GNU Go 3.8                    1/28


League B:

Code: Select all

    1. GNU Go 3.8                   28/32
    2. Michi-C                      26/32
    3. Hara 0.9                     19/32
    4. Dariush 3.1.5.7              17/32
    5. Indigo 2009                  15/32
    6. Matilda 1.24                 15/32
    7. Aya 6.34                     11/32
    8. Fudo Go 3.0                  11/32
    9. JrefBot 081016-2022           2/32


League C:

Code: Select all

    1. JrefBot 081016-2022          24/24
    2. AmiGo 1.8                    18/24
    3. Crazy Patterns 0008-13       17/24
    4. Stop 0.9-005                 10/24
    5. CopyBot 0.1                   8/24
    6. Brown 1.0                     7/24
    7. MattpkGo 1.0                  0/24


All engines are set up to play 1h/game with pondering off, one thread and Memory around 1GB.

Configuration:
Aya.exe –mode gtp –level max

DarGTP.exe –level 10

taskset -c 1 fudo –boardsize=19 –komi=6.5

fuego.exe –config fuego.cfg

Code: Select all

fuego.cfg:
uct_param_search number_threads 1
uct_param_search lock_free 0
uct_max_memory 1024000000
uct_param_player reuse_subtree 1
uct_param_player ponder 0
uct_param_player early_pass 1

gnugo --mode gtp --level 10 --resign-allowed

hara

taskset -c 0 Hiratuka-19×19.exe -po 15000

Indigo.exe -gtp

java -jar /home/alex/Programme/Engines/Go/jrefgo.jar 10000

leela –gtp –threads 1 –noponder

matilda

Code: Select all

matilda.h:
#define BOARD_SIZ 19
#define DEFAULT_UCT_MEMORY 1000
#define DEFAULT_NUM_THREADS 1

michi gtp

Code: Select all

michi.c
Komi 6.5

michi.h
N 19
N-SIMS 10000

mogo

java -jar /home/alex/Programme/Engines/Go/orego-7.08.jar threads=1 grace

pachi -f pachibook.dat threads=1,max_tree_size=1024,pondering=0

ray --time 3600 --thread 1 --no-debug


TWOGTP=”gogui-twogtp -black \”$BLACK\” -white \”$WHITE\” -games 2 -size 19 -time 60 -sgffile xxxx”
gogui -size 19 -program “$TWOGTP” -computer-both -auto


Best,
Alex
q30
Lives with ko
Posts: 145
Joined: Sat Aug 13, 2016 8:23 am
Rank: 30 kyu
GD Posts: 0
Has thanked: 1 time
Been thanked: 1 time

Re: Engine Tournament

Post by q30 »

Hi, Alex!

Can You explain, how is it possible to run Hiratuka in GTP mode (what a command is the 'taskset -c 0')?

Thanks in advance.
as0770
Lives with ko
Posts: 180
Joined: Sun Jun 26, 2016 8:07 am
Rank: Beginner
GD Posts: 0
Has thanked: 15 times
Been thanked: 23 times

Re: Engine Tournament

Post by as0770 »

q30 wrote:Hi, Alex!

Can You explain, how is it possible to run Hiratuka in GTP mode (what a command is the 'taskset -c 0')?

Thanks in advance.


Hi,

I run the windows .exe under Linux. The -po parameter is the number of playouts. Hiratuka will use by default all available cores so I use the taskset command to force the core number, "taskset -c 0" means the program uses core number 0 (4 cores are numbered 0,1,2,3). You can also run two cores by "taskset -c 0,1". If you run more programs with taskset be sure to take different core numbers. There is something similar in windows afaik.

Best,
Alex
Post Reply