Engine Tournament

as0770 · Post by **as0770** » Fri Jul 07, 2017 11:10 pm

q30 wrote:No, Leela has up to 2 min/move (see twogtp.jar parameters) and Hiratuka, how I had written, has 1 min/move...

That's why I'm asking: "gogui-twogtp.jar -time 1s+2/1"

q30 · Post by **q30** » Fri Jul 14, 2017 8:03 am

Leela makes a few moves in first second (how and Hiratuka nevertheless of gogui parameters - I think, because embedded opening book) and then thinks up to 2 min/move (Hiratuka thinks with enough -po parameter value 1 min/move because of embedded limits). You can try run with mentioned parameters and see all yourself...

q30 · Post by **q30** » Fri Jul 14, 2017 8:08 am

Ray became a bit stronger (not against Hiratuka: details), but the rate is the same.
Distribution is renewed.

gamesorry · Post by **gamesorry** » Sun Jul 16, 2017 10:41 pm

The OGS Alan Turing Main Title Tournament 2017 (https://online-go.com/tournament/27492) will begin in a week on July 22, 2017. 150 players, including strong bots like RoyalLeela and Valkyria, have signed up so far.

It would be great if some of the engines here could join the tournament and play with other engines/human players!

as0770 · Post by **as0770** » Mon Jul 17, 2017 9:36 pm

Update League A with Rayon 4.6.0, now 2h/game and 4 threads.

League A:

Code: Select all

    1. Leela 0.10.0                 18/20
    2. Rayon 4.6.0                  15/20
    3. Oakfoam 0.2.1 NG-06          14/20
    4. DarkForest v2 MCTS 1.0        7/20
    5. Hiratuka 10.37B (CPU)         6/20
    6. Pachi 11.99                   0/20

Configuration:

League B:

Code: Select all

    1. Pachi 11.99                  23/24
    2. MoGo 4.86                    19/24
    3. deltaGo 1.0.0                14/24
    4. Fuego 1.1                    13/24
    5. Michi C-2 1.4.2               8/24
    6. Orego 7.08                    5/24
    7. GNU Go 3.8                    2/24

Configuration:

League C:

Code: Select all

    1. GNU Go 3.8                   24/28
    2. Hara 0.9                     18/28
    3. Dariush 3.1.5.7              16/28
    4. Indigo 2009                  15/28
    5. Matilda 1.24                 15/28
    6. Aya 6.34                     11/28
    7. Fudo Go 3.0                  11/28
    8. JrefBot 081016-2022           2/28

Configuration:

League D:

Code: Select all

    1. JrefBot 081016-2022          25/28
    2. Iomrascálaí 0.3.2            21/28
    3. Crazy Patterns 0008-13       19/28
    4. Marcos Go 1.0                18/28
    5. AmiGo 1.8                    16/28
    6. Stop 0.9-005                  6/28
    7. CopyBot 0.1                   4/28
    8. Brown 1.0                     3/28

Configuration:

Links:

Best,
Alex

Cyan · Post by **Cyan** » Wed Jul 19, 2017 4:17 pm

Please add DarkGo! It's a neural network at around 1d level.
https://pjreddie.com/darknet/darkgo-go-in-darknet/
How to run in GTP: https://groups.google.com/forum/#!topic ... BNZTkMmUHI

Also you can try Hiratuka 10.38B since you're using GPU anyway.

Pachi can use neural networks as well, if you're not using them already.
https://github.com/pasky/pachi

as0770 · Post by **as0770** » Thu Jul 20, 2017 8:00 am

Cyan wrote:Please add DarkGo! It's a neural network at around 1d level.
https://pjreddie.com/darknet/darkgo-go-in-darknet/
How to run in GTP: https://groups.google.com/forum/#!topic ... BNZTkMmUHI

Also you can try Hiratuka 10.38B since you're using GPU anyway.

Pachi can use neural networks as well, if you're not using them already.
https://github.com/pasky/pachi

Thanks for the hints, I had Pachi with neural networks on my list but I wasn't aware of DarkGo.

Unfortunately Hiratuka 10.38B doesn't run on my Linux machine because of a cuda error...

Cyan · Post by **Cyan** » Thu Jul 20, 2017 10:44 am

as0770 wrote:Thanks for the hints, I had Pachi with neural networks on my list but I wasn't aware of DarkGo.

Unfortunately Hiratuka 10.38B doesn't run on my Linux machine because of a cuda error...

You're welcome! Also are you making sure that the programs are using as close to two hours as possible? For example you can add the argument -t _7200 to pachi to tell it to use two hours. I've noticed that in gogui-twogtp you're giving the engines two hours (i.e. -time 120) but you're only giving ray one hour (i.e. --time 3600). FYI rn-4.6.1 has just been released.

as0770 · Post by **as0770** » Thu Jul 20, 2017 11:36 am

Cyan wrote:Also are you making sure that the programs are using as close to two hours as possible? For example you can add the argument -t _7200 to pachi to tell it to use two hours. I've noticed that in gogui-twogtp you're giving the engines two hours (i.e. -time 120) but you're only giving ray one hour (i.e. --time 3600). FYI rn-4.6.1 has just been released.

I use Ray without the --time 3600 argument, it was a typo in the configuration section and I just corrected it. Ray and Pachi seem to work well with the gtp time command, I observe all games also in matter of time consumption. The engines with fixed playouts use in average 48 seconds per move after 50-100 moves. For the games against DarkForrest I measure how much each engine is slowed down by the CPU usage of DarkForrest and give it more time. So I think it is as fair as possible

as0770 · Post by **as0770** » Mon Jul 24, 2017 3:15 am

Update League A with DarkGo, it won 1 against Pachi and Hiratuka, and 3 against DarkForrest, next Update will be Pachi DCNN.

League A:with

Code: Select all

    1. Leela 0.10.0                 22/24
    2. Rayon 4.6.0                  19/24
    3. Oakfoam 0.2.1 NG-06          18/24
    4. Hiratuka 10.37B (CPU)        10/24
    5. DarkForest v2 MCTS 1.0        7/24
    6  DarkGo 1.0                    5/24
    7. Pachi 11.99                   3/24

Configuration:

League B:

Code: Select all

    1. Pachi 11.99                  23/24
    2. MoGo 4.86                    19/24
    3. deltaGo 1.0.0                14/24
    4. Fuego 1.1                    13/24
    5. Michi C-2 1.4.2               8/24
    6. Orego 7.08                    5/24
    7. GNU Go 3.8                    2/24

Configuration:

League C:

Code: Select all

    1. GNU Go 3.8                   24/28
    2. Hara 0.9                     18/28
    3. Dariush 3.1.5.7              16/28
    4. Indigo 2009                  15/28
    5. Matilda 1.24                 15/28
    6. Aya 6.34                     11/28
    7. Fudo Go 3.0                  11/28
    8. JrefBot 081016-2022           2/28

Configuration:

League D:

Code: Select all

    1. JrefBot 081016-2022          25/28
    2. Iomrascálaí 0.3.2            21/28
    3. Crazy Patterns 0008-13       19/28
    4. Marcos Go 1.0                18/28
    5. AmiGo 1.8                    16/28
    6. Stop 0.9-005                  6/28
    7. CopyBot 0.1                   4/28
    8. Brown 1.0                     3/28

Configuration:

Links:

Best,
Alex

as0770 · Post by **as0770** » Sun Jul 30, 2017 10:04 pm

Update League A with Pachi DCNN.

League A:

Code: Select all

    1. Leela 0.10.0                 22/24
    2. Rayon 4.6.0                  19/24
    3. Oakfoam 0.2.1 NG-06          18/24
    4. Hiratuka 10.37B (CPU)         9/24
    5. DarkForest v2 MCTS 1.0        7/24
    6  DarkGo 1.0                    5/24
    7. Pachi DCNN 11.99              4/24

Configuration:

League B:

Code: Select all

    1. Pachi 11.99                  23/24
    2. MoGo 4.86                    19/24
    3. deltaGo 1.0.0                14/24
    4. Fuego 1.1                    13/24
    5. Michi C-2 1.4.2               8/24
    6. Orego 7.08                    5/24
    7. GNU Go 3.8                    2/24

Configuration:

League C:

Code: Select all

    1. GNU Go 3.8                   24/28
    2. Hara 0.9                     18/28
    3. Dariush 3.1.5.7              16/28
    4. Indigo 2009                  15/28
    5. Matilda 1.24                 15/28
    6. Aya 6.34                     11/28
    7. Fudo Go 3.0                  11/28
    8. JrefBot 081016-2022           2/28

Configuration:

League D:

Code: Select all

    1. JrefBot 081016-2022          25/28
    2. Iomrascálaí 0.3.2            21/28
    3. Crazy Patterns 0008-13       19/28
    4. Marcos Go 1.0                18/28
    5. AmiGo 1.8                    16/28
    6. Stop 0.9-005                  6/28
    7. CopyBot 0.1                   4/28
    8. Brown 1.0                     3/28

Configuration:

Links:

Best,
Alex

Shoreline · Post by **Shoreline** » Mon Jul 31, 2017 8:19 pm

How do you guys gets the Orego 7.08 running?

I downloaded Jar file, unziped, or downloaded the 7.14 version release and javac compiled with no erros. However,
I can not get the software running in linux Ubuntu 14.04. Erros:
java -ea -Xmx1024M edu.lclark.orego.ui.Orego
Error: Could not find or load main class edu.lclark.orego.ui.Orego

No matter how I switched to src folder, or change to localhost.Orego or just Orego, it does not run

as0770 · Post by **as0770** » Mon Jul 31, 2017 9:34 pm

Shoreline wrote:How do you guys gets the Orego 7.08 running?

I downloaded Jar file, unziped, or downloaded the 7.14 version release and javac compiled with no erros. However,
I can not get the software running in linux Ubuntu 14.04. Erros:
java -ea -Xmx1024M edu.lclark.orego.ui.Orego
Error: Could not find or load main class edu.lclark.orego.ui.Orego

No matter how I switched to src folder, or change to localhost.Orego or just Orego, it does not run

I had problems running later versions because of similar problems. v7.08 works by adding:

Main-Class: orego.ui.Orego

to /META-INF/MANIFEST.MF inside the .jar file.

Then execute the .jar file by:

java -jar /path to/orego-7.08.jar threads=1 grace

If you get later versions to work let me know

Best,
Alex

Shoreline · Post by **Shoreline** » Tue Aug 01, 2017 5:17 am

as0770 wrote:
Shoreline wrote:How do you guys gets the Orego 7.08 running?

I downloaded Jar file, unziped, or downloaded the 7.14 version release and javac compiled with no erros. However,
I can not get the software running in linux Ubuntu 14.04. Erros:
java -ea -Xmx1024M edu.lclark.orego.ui.Orego
Error: Could not find or load main class edu.lclark.orego.ui.Orego

No matter how I switched to src folder, or change to localhost.Orego or just Orego, it does not run
I had problems running later versions because of similar problems. v7.08 works by adding:

Main-Class: orego.ui.Orego

to /META-INF/MANIFEST.MF inside the .jar file.

Then execute the .jar file by:

java -jar /path to/orego-7.08.jar threads=1 grace

If you get later versions to work let me know

Best,
Alex

Thanks, I got it running like you said. However, I found it is very weak bot at 19x19. How come this Orego 7.08 ranks so high against gnugo?
It appears that it is several stones weaker than gnugo.

as0770 · Post by **as0770** » Tue Aug 01, 2017 12:54 pm

Shoreline wrote:Thanks, I got it running like you said. However, I found it is very weak bot at 19x19. How come this Orego 7.08 ranks so high against gnugo?
It appears that it is several stones weaker than gnugo.

Here it won 4-0 against GnuGo 3.8, the games where all close. I think one has to play much more games to see which one is stronger.

Life In 19x19

Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament

Re: Engine Tournament