It is currently Sun Nov 10, 2024 12:47 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 402 posts ]  Go to page Previous  1, 2, 3, 4, 5, 6 ... 21  Next
Author Message
Offline
 Post subject: Re: Engine Tournament
Post #41 Posted: Thu Nov 24, 2016 2:40 am 
Dies in gote

Posts: 23
Liked others: 1
Was liked: 9
as0770 wrote:

Unfortunately I have not been able to compile it for Linux...

Alex


It requires CNTK https://github.com/Microsoft/CNTK/releases
and it has a Visual Studio project file, so you can use visual studio to compile

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #42 Posted: Sat Nov 26, 2016 1:52 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
as0770 wrote:
I got 4 cores only. So pondering and 2 cores/engines would result in unfair allocation of CPU time. I think even more important is the number of games. 24 games under this conditions will give a better result than 12 games with doubled time or 2 cores for each engine.
Still this 24 games are statistically not significant. To get a correct reflection of the strength you need at least 100 games/engine. I just want to get a fast and rough estimation of the strength. Anyway, maybe I will improve the conditions for the top engines one day :)

Yes, it will be unfair allocation of CPU time (I have 4 core CPU too). And yes, statistically 24 games not so significant for this level of causality. But there isn't so important number of games, if You are randomizing the games very much. In such case You can get only statistical information about quality and number of used opening book, patterns and specific local position algorithms (I'm not guru nor in English, nor in Go, so it may be, that I give not correct terminology). And the main (for serious games with human) algorithm, that is based on simulations number and therefore is depending on time*performance settings in such sparring games isn't testing...
In one phrase: for given total number of simulations more adequate result is getting in less number of games.

And, Alex, why You are not sparring MoGo version 4.86?


Last edited by q30 on Sat Jun 24, 2017 4:58 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #43 Posted: Sat Nov 26, 2016 2:02 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
I have tested leela_080_linux_x64. Go engines rate not changed (sparrings by GTP on one computer with a half of processor and memory limits for each engine):

League A
1. Leela

League B
2. Ray
3. Pachi
4. MoGo

Go engines non default compiling and start up parameters.
leela_080_linux_x64 start up parameters: -g -t 2 -b 0

Leela's developer has selected non standard way for time control. In contrast to all other Go engines in leela_080_linux_x64 it's possible get only the time per move and only by subtraction from external application time per move setting the --lagbuffer (-b) parameter value. For example, if someone adds in GoGUI a few Leela's game strength levels, then he must start gogui.jar (excepting displaying the contestants elapsed times) with "-time 1s+21474836s/1" (for example - the maximal compensable by Leela's -b parameter) and add (in Menu/ Program/ New Program), for example, the next (with path to executive file leela_080_linux_x64 in Working directory):
1) ./leela_080_linux_x64 -g -b 2147483500
2) ./leela_080_linux_x64 -g -b 2147471600
3) ./leela_080_linux_x64 -g -b 0
(1 - for 1 sec per move; 2 - for 2 min per move; 3 - for 357914 min per move)

Engines. Games.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #44 Posted: Sun Dec 18, 2016 2:43 pm 
Dies with sente

Posts: 101
Liked others: 2
Was liked: 16
Rank: KGS 2 D
On my computer Leela 0.8.0 is much stronger than Hiratuka 10.37B, appeared from several matches with twogtp. I have included in the GoGUI with the following command line,

C:\PPDownload\Hiratuka10_37B\gogui-twogtp.exe -black "Leela080.exe --gtp --noponder --threads 2"
-white "Hiratuka-19x19.exe -po 25000" -alternate

I don't have GPU on my AMD Athlon computer. Attached is one of the matches.


Attachments:
1218leela-hira.sgf [1.31 KiB]
Downloaded 832 times
Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #45 Posted: Fri Mar 10, 2017 11:33 pm 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
splee99 wrote:
...--noponder...

Using of this parameter isn't a good idea, because all gamers are thinking on their opponents turn...

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #46 Posted: Fri Mar 10, 2017 11:43 pm 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
With new version of Leela the rate is the same:
Quote:
League A
1. Leela

League B
2. Ray
3. Pachi
4. MoGo

Leela 0.9.0 got stronger and, of course, remained the strongest Go engine (with GTP support). Is there any such engine, that can show at least slight resistance to Leela?

Go engines non default compiling and start up parameters.
leela_090_linux_x64 start up parameters: -g -t 2 -b 0 (with: gogui-twogtp.jar -verbose -komi 7.5 -time 1s+2/1)

Leela has new thinking process. For example, on GoGUI shell You can see: "Nodes: 248096, Win: 51.81% (MC:42.27%/VN:63.46%), PV: M8 M10 N9 N10 P9 P6",- where win percentage is now average of old Monte Carlo (MC) and some new VN algorithms. Leela's developer has selected non standard way for time control. In contrast to all other Go engines in Leela it's possible get only the time per move and only by subtraction from external application time per move setting the --lagbuffer (-b) parameter value. For example, if someone adds in GoGUI a few Leela's game strength levels, then he must start gogui.jar (excepting displaying the contestants elapsed times) with "-time 1s+21474836s/1" (for example - the maximal compensable by Leela's -b parameter) and add (in Menu/ Program/ New Program), for example, the next (with path to executive file leela_090_linux_x64 in Working directory):
1) ./leela_090_linux_x64 -g -b 2147483500
2) ./leela_090_linux_x64 -g -b 2147471600
3) ./leela_090_linux_x64 -g -b 0
(1 - for 1 sec per move; 2 - for 2 min per move; 3 - for 357914 min per move)

Engines. Games.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #47 Posted: Sat Mar 11, 2017 10:03 am 
Dies in gote

Posts: 69
Location: Connecticut, USA
Liked others: 0
Was liked: 5
Rank: DGS 9 kyu
DGS: Shoreline
OGS: Shoreline
Hi all,

It is nice to read the old post here on these bots comparison.
I actually did similar things at end of 2016 and early 2017. I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Shoreline

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #48 Posted: Sat Mar 11, 2017 2:03 pm 
Lives with ko

Posts: 180
Liked others: 15
Was liked: 23
Rank: Beginner
Shoreline wrote:
Hi all,

It is nice to read the old post here on these bots comparison.
I actually did similar things at end of 2016 and early 2017. I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Shoreline


This executable works here on Ubuntu 16.04. Even the windows binary works with wine.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #49 Posted: Sat Mar 11, 2017 7:38 pm 
Dies in gote

Posts: 69
Location: Connecticut, USA
Liked others: 0
Was liked: 5
Rank: DGS 9 kyu
DGS: Shoreline
OGS: Shoreline
as0770 wrote:
Shoreline wrote:
Hi all,

It is nice to read the old post here on these bots comparison.
I actually did similar things at end of 2016 and early 2017. I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Shoreline


This executable works here on Ubuntu 16.04. Even the windows binary works with wine.


Found the reason. This is 32 bits binary, does not work natively in 64 bits linux. By doing the compatible library installation, it trashed my virtual machine system.

Well, I will just have to give it up, not worth trying it out.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #50 Posted: Sat Mar 11, 2017 11:45 pm 
Lives with ko

Posts: 180
Liked others: 15
Was liked: 23
Rank: Beginner
Shoreline wrote:
as0770 wrote:
Shoreline wrote:
Hi all,

It is nice to read the old post here on these bots comparison.
I actually did similar things at end of 2016 and early 2017. I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Shoreline


This executable works here on Ubuntu 16.04. Even the windows binary works with wine.


Found the reason. This is 32 bits binary, does not work natively in 64 bits linux. By doing the compatible library installation, it trashed my virtual machine system.

Well, I will just have to give it up, not worth trying it out.


My system is also 64 Bit. Anyway, Mogo is quite similar to Fuego :)

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #51 Posted: Sun Mar 12, 2017 3:25 pm 
Dies in gote

Posts: 69
Location: Connecticut, USA
Liked others: 0
Was liked: 5
Rank: DGS 9 kyu
DGS: Shoreline
OGS: Shoreline
as0770 wrote:
Shoreline wrote:

Found the reason. This is 32 bits binary, does not work natively in 64 bits linux. By doing the compatible library installation, it trashed my virtual machine system.

Well, I will just have to give it up, not worth trying it out.


My system is also 64 Bit. Anyway, Mogo is quite similar to Fuego :)


Here is legacy inactive robot account at DGS using MoGo:
http://www.dragongoserver.net/userinfo.php?uid=44779

It needs 10 minutes per move set up in dual core computer and only achieved 8 kyu level at DGS by looking at the chart. Not sure your setup needs that kind of thinking time to be competitive. For fuego to achieve 5 kyu to 7 kyu at DGS, my redrobot at DGS only runs on a 10 seconds per move thinking time (default) in dual core linux computer. Here is redrobot at DGS:
http://www.dragongoserver.net/userinfo.php?uid=97563

It appears that on resource wise, and strength, MoGo is not very competitive compared to Fuego.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #52 Posted: Sat Mar 18, 2017 3:19 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Shoreline wrote:
I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Try from here.
You must have x86_64 version of Linux (elsewhere You must compile MoGo 4.86).

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #53 Posted: Sat Mar 18, 2017 3:24 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
as0770 wrote:
My system is also 64 Bit. Anyway, Mogo is quite similar to Fuego :)

MoGo (all versions) are stronger, than FueGo, and have a huge number of start up parameters (see link above).

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #54 Posted: Sat Mar 18, 2017 3:32 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Shoreline wrote:
It appears that on resource wise, and strength, MoGo is not very competitive compared to Fuego.

See here games, including between MoGo and FueGo (all games are with the same PC resources given for each engine).

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #55 Posted: Sat Mar 18, 2017 8:41 pm 
Dies in gote

Posts: 69
Location: Connecticut, USA
Liked others: 0
Was liked: 5
Rank: DGS 9 kyu
DGS: Shoreline
OGS: Shoreline
q30 wrote:
Shoreline wrote:
I am curious how can you guys run linux version of MoGo?

There is web page for downloading mogo linux binary from the web page:
https://www.lri.fr/~teytaud/mogo.html

But actually the downloaded file "mogor" is not executable in Ubuntu 14.04 linux machine, it throw out error something like "can not find file ...."

Try from here.
You must have x86_64 version of Linux (elsewhere You must compile MoGo 4.86).


Thanks for providing MoGo X64 linux binary. Indeed, MoGo 4.86 in my machine can beat Fuego easily with similar thinking time and resource.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #56 Posted: Sat Mar 25, 2017 2:26 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Shoreline wrote:
Thanks for providing MoGo X64 linux binary. Indeed, MoGo 4.86 in my machine can beat Fuego easily with similar thinking time and resource.

All MoGo versions with parameters by link above beat FueGo too...
Moreover, in games by this link You can see, that MoGo versions can't beat unambiguously each other (even 32-bit version)...

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #57 Posted: Sat May 27, 2017 3:47 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Leela in version 0.10.0 became stronger and, of course, remains the strongest Go engine (at least among engines with GTP support). Details.
But it still has two disadvantages:
1) the time control;
2) very late resigning (for example, it wasn't resign with win percentage by VN 0,00% until by MC was >20%...)

With new version of Leela the rate is the same:
Quote:
League A
1. Leela

League B
2. Ray
3. Pachi
4. MoGo

Go engines non default compiling and start up parameters.
leela_0100_linux_x64 start up parameters: -g -t 2 -b 0 (with: gogui-twogtp.jar -verbose -komi 7.5 -time 1s+2/1)


Engines. Games.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #58 Posted: Fri Jun 02, 2017 12:53 am 
Lives with ko

Posts: 180
Liked others: 15
Was liked: 23
Rank: Beginner
Hi,

here is an Update with Leela 0.10.0, Mogo 4.86, Orego 7.08 and Matilda 1.24.

Leela 0.8.0 won 14-10 against Hiratuka, Leela 0.10.0 now wins by 16-0.

Leela vs. Hiratuka:
Code:
    1. Leela 0.10.0                   16/16
    2. Hiratuka 10.37B                0/16


League A:
Code:
    1. Leela 0.10.0                 28/28
    2. Hiratuka 10.37B              23/28
    3. PachiUCT 11.99               18/28
    4. Ray 8.0.1                    17/28
    5. Mogo 4.86                    13/28
    6. Fuego 1.1                     8/28
    7. Orego 7.08                    4/28
    8. GNU Go 3.8                    1/28


League B:
Code:
    1. GNU Go 3.8                   28/32
    2. Michi-C                      26/32
    3. Hara 0.9                     19/32
    4. Dariush 3.1.5.7              17/32
    5. Indigo 2009                  15/32
    6. Matilda 1.24                 15/32
    7. Aya 6.34                     11/32
    8. Fudo Go 3.0                  11/32
    9. JrefBot 081016-2022           2/32


League C:
Code:
    1. JrefBot 081016-2022          24/24
    2. AmiGo 1.8                    18/24
    3. Crazy Patterns 0008-13       17/24
    4. Stop 0.9-005                 10/24
    5. CopyBot 0.1                   8/24
    6. Brown 1.0                     7/24
    7. MattpkGo 1.0                  0/24


All engines are set up to play 1h/game with pondering off, one thread and Memory around 1GB.

Configuration:
Aya.exe –mode gtp –level max

DarGTP.exe –level 10

taskset -c 1 fudo –boardsize=19 –komi=6.5

fuego.exe –config fuego.cfg
Code:
fuego.cfg:
uct_param_search number_threads 1
uct_param_search lock_free 0
uct_max_memory 1024000000
uct_param_player reuse_subtree 1
uct_param_player ponder 0
uct_param_player early_pass 1

gnugo --mode gtp --level 10 --resign-allowed

hara

taskset -c 0 Hiratuka-19×19.exe -po 15000

Indigo.exe -gtp

java -jar /home/alex/Programme/Engines/Go/jrefgo.jar 10000

leela –gtp –threads 1 –noponder

matilda
Code:
matilda.h:
#define BOARD_SIZ 19
#define DEFAULT_UCT_MEMORY 1000
#define DEFAULT_NUM_THREADS 1

michi gtp
Code:
michi.c
Komi 6.5

michi.h
N 19
N-SIMS 10000

mogo

java -jar /home/alex/Programme/Engines/Go/orego-7.08.jar threads=1 grace

pachi -f pachibook.dat threads=1,max_tree_size=1024,pondering=0

ray --time 3600 --thread 1 --no-debug


TWOGTP=”gogui-twogtp -black \”$BLACK\” -white \”$WHITE\” -games 2 -size 19 -time 60 -sgffile xxxx”
gogui -size 19 -program “$TWOGTP” -computer-both -auto


Best,
Alex

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #59 Posted: Sat Jun 03, 2017 1:19 am 
Lives with ko

Posts: 145
Liked others: 1
Was liked: 1
Rank: 30 kyu
Hi, Alex!

Can You explain, how is it possible to run Hiratuka in GTP mode (what a command is the 'taskset -c 0')?

Thanks in advance.

Top
 Profile  
 
Offline
 Post subject: Re: Engine Tournament
Post #60 Posted: Sat Jun 03, 2017 7:00 am 
Lives with ko

Posts: 180
Liked others: 15
Was liked: 23
Rank: Beginner
q30 wrote:
Hi, Alex!

Can You explain, how is it possible to run Hiratuka in GTP mode (what a command is the 'taskset -c 0')?

Thanks in advance.


Hi,

I run the windows .exe under Linux. The -po parameter is the number of playouts. Hiratuka will use by default all available cores so I use the taskset command to force the core number, "taskset -c 0" means the program uses core number 0 (4 cores are numbered 0,1,2,3). You can also run two cores by "taskset -c 0,1". If you run more programs with taskset be sure to take different core numbers. There is something similar in windows afaik.

Best,
Alex

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 402 posts ]  Go to page Previous  1, 2, 3, 4, 5, 6 ... 21  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group