Thanks for the hints, I had Pachi with neural networks on my list but I wasn't aware of DarkGo.
Unfortunately Hiratuka 10.38B doesn't run on my Linux machine because of a cuda error...
Re: Engine Tournament
Posted: Thu Jul 20, 2017 10:44 am
by Cyan
as0770 wrote:Thanks for the hints, I had Pachi with neural networks on my list but I wasn't aware of DarkGo.
Unfortunately Hiratuka 10.38B doesn't run on my Linux machine because of a cuda error...
You're welcome! Also are you making sure that the programs are using as close to two hours as possible? For example you can add the argument -t _7200 to pachi to tell it to use two hours. I've noticed that in gogui-twogtp you're giving the engines two hours (i.e. -time 120) but you're only giving ray one hour (i.e. --time 3600). FYI rn-4.6.1 has just been released.
Re: Engine Tournament
Posted: Thu Jul 20, 2017 11:36 am
by as0770
Cyan wrote:Also are you making sure that the programs are using as close to two hours as possible? For example you can add the argument -t _7200 to pachi to tell it to use two hours. I've noticed that in gogui-twogtp you're giving the engines two hours (i.e. -time 120) but you're only giving ray one hour (i.e. --time 3600). FYI rn-4.6.1 has just been released.
I use Ray without the --time 3600 argument, it was a typo in the configuration section and I just corrected it. Ray and Pachi seem to work well with the gtp time command, I observe all games also in matter of time consumption. The engines with fixed playouts use in average 48 seconds per move after 50-100 moves. For the games against DarkForrest I measure how much each engine is slowed down by the CPU usage of DarkForrest and give it more time. So I think it is as fair as possible
Re: Engine Tournament
Posted: Mon Jul 24, 2017 3:15 am
by as0770
Update League A with DarkGo, it won 1 against Pachi and Hiratuka, and 3 against DarkForrest, next Update will be Pachi DCNN.
I downloaded Jar file, unziped, or downloaded the 7.14 version release and javac compiled with no erros. However,
I can not get the software running in linux Ubuntu 14.04. Erros:
java -ea -Xmx1024M edu.lclark.orego.ui.Orego
Error: Could not find or load main class edu.lclark.orego.ui.Orego
No matter how I switched to src folder, or change to localhost.Orego or just Orego, it does not run
Re: Engine Tournament
Posted: Mon Jul 31, 2017 9:34 pm
by as0770
Shoreline wrote:How do you guys gets the Orego 7.08 running?
I downloaded Jar file, unziped, or downloaded the 7.14 version release and javac compiled with no erros. However,
I can not get the software running in linux Ubuntu 14.04. Erros:
java -ea -Xmx1024M edu.lclark.orego.ui.Orego
Error: Could not find or load main class edu.lclark.orego.ui.Orego
No matter how I switched to src folder, or change to localhost.Orego or just Orego, it does not run
I had problems running later versions because of similar problems. v7.08 works by adding:
Main-Class: orego.ui.Orego
to /META-INF/MANIFEST.MF inside the .jar file.
Then execute the .jar file by:
java -jar /path to/orego-7.08.jar threads=1 grace
If you get later versions to work let me know
Best,
Alex
Re: Engine Tournament
Posted: Tue Aug 01, 2017 5:17 am
by Shoreline
as0770 wrote:
Shoreline wrote:How do you guys gets the Orego 7.08 running?
I downloaded Jar file, unziped, or downloaded the 7.14 version release and javac compiled with no erros. However,
I can not get the software running in linux Ubuntu 14.04. Erros:
java -ea -Xmx1024M edu.lclark.orego.ui.Orego
Error: Could not find or load main class edu.lclark.orego.ui.Orego
No matter how I switched to src folder, or change to localhost.Orego or just Orego, it does not run
I had problems running later versions because of similar problems. v7.08 works by adding:
Main-Class: orego.ui.Orego
to /META-INF/MANIFEST.MF inside the .jar file.
Then execute the .jar file by:
java -jar /path to/orego-7.08.jar threads=1 grace
If you get later versions to work let me know
Best,
Alex
Thanks, I got it running like you said. However, I found it is very weak bot at 19x19. How come this Orego 7.08 ranks so high against gnugo?
It appears that it is several stones weaker than gnugo.
Re: Engine Tournament
Posted: Tue Aug 01, 2017 12:54 pm
by as0770
Shoreline wrote:Thanks, I got it running like you said. However, I found it is very weak bot at 19x19. How come this Orego 7.08 ranks so high against gnugo?
It appears that it is several stones weaker than gnugo.
Here it won 4-0 against GnuGo 3.8, the games where all close. I think one has to play much more games to see which one is stronger.
Re: Engine Tournament
Posted: Tue Aug 01, 2017 1:31 pm
by Shoreline
I wonder if the java version or OS made the difference. I am using a linux machine,
dual core, 8G of memory, quite low end machine. The java verison I am using is:
$ java -version
java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)
I would say in my setting, the Orego version 7.08 is probably more than 9 stones weaker than gnugo, it probably ranks below 20 kyu in DGS.
Re: Engine Tournament
Posted: Tue Aug 01, 2017 4:58 pm
by Cyan
Here are estimates of goratings elo of different bots (from various sources and also my own testing). GPU is assumed to be high-end (e.g. 1080 Ti). Good to put things into perspective.
AlphaGo ~4800 elo
Ke Jie ~3700 elo
DeepZenGo ~3600 elo
Average pro =3000 elo
Ray GPU ~2700 elo
Leela GPU ~2500 elo
Hira GPU ~2300 elo
Leela ~2100 elo
Zen 6 ~2100 elo
Hira ~1900 elo
DarkGo ~1600 elo
Pachi ~1300 elo
1k player ~1000 elo
Re: Engine Tournament
Posted: Wed Aug 02, 2017 7:11 am
by as0770
Shoreline wrote:I wonder if the java version or OS made the difference. I am using a linux machine,
dual core, 8G of memory, quite low end machine. The java verison I am using is:
$ java -version
java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)
I would say in my setting, the Orego version 7.08 is probably more than 9 stones weaker than gnugo, it probably ranks below 20 kyu in DGS.
This is my Java version:
java -version
openjdk version "1.8.0_131"
OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
Does Orego use all the available time? Maybe you use a time setting that Orego doesn't support and it moves faster.
Re: Engine Tournament
Posted: Wed Aug 02, 2017 10:19 am
by Shoreline
as0770 wrote:
Shoreline wrote:I wonder if the java version or OS made the difference. I am using a linux machine,
dual core, 8G of memory, quite low end machine. The java verison I am using is:
$ java -version
java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)
I would say in my setting, the Orego version 7.08 is probably more than 9 stones weaker than gnugo, it probably ranks below 20 kyu in DGS.
This is my Java version:
java -version
openjdk version "1.8.0_131"
OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
Does Orego use all the available time? Maybe you use a time setting that Orego doesn't support and it moves faster.
The Orego in my machine moves bleedingly fast, may be 1 second per move. It can play 5 or 10 different games within 10 seconds.
How can I change the time setting in GTP command? Maybe that is the issue.
Checked GTP manual and list_commands of Orego, found 2 commands is related "time_settings" "time_left". Not sure how to use them in games.
Re: Engine Tournament
Posted: Wed Aug 02, 2017 10:31 am
by as0770
Shoreline wrote:
as0770 wrote:
Shoreline wrote:I wonder if the java version or OS made the difference. I am using a linux machine,
dual core, 8G of memory, quite low end machine. The java verison I am using is:
$ java -version
java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)
I would say in my setting, the Orego version 7.08 is probably more than 9 stones weaker than gnugo, it probably ranks below 20 kyu in DGS.
This is my Java version:
java -version
openjdk version "1.8.0_131"
OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
Does Orego use all the available time? Maybe you use a time setting that Orego doesn't support and it moves faster.
The Orego in my machine moves bleedingly fast, may be 1 second per move. It can play 5 or 10 different games within 10 seconds.
How can I change the time setting in GTP command? Maybe that is the issue.
I use game in x for my testing because this works with most engines. The gtp command is:
time_settings 3600 0 0
for a game in 60 minutes. But Orego uses some more time as allowed.