KataGo Distributed Training and new networks

For discussing go computing, software announcements, etc.
hope366
Dies in gote
Posts: 20
Joined: Wed Jun 10, 2020 8:08 am
Rank: KGS3dan
GD Posts: 0
Been thanked: 3 times

Re: KataGo Distributed Training and new networks

Post by hope366 »

If anyone has a CUDA version of KataGo for the new architecture, could you please upload it?
I tried to compile using cmake before, but it didn't work in my environment.
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

and the version of eigenavx2 for Windows please! :)
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

KataGo 18b, playouts 10 - 60b, playouts 10

Attachments
18b - 60b.sgf
(1.13 KiB) Downloaded 1629 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

PC_Screen wrote:Katago Eigen, same process, drop it inside the katago 1.11 eigen folder and replace the old katago.exe.

https://drive.google.com/file/d/18XJHc8 ... sp=sharing

As for the speed being lower, try running the benchmark in the command prompt (./katago.exe benchmark -model <NEURALNET>.bin.gz) and adjust the number of search threads based on it
many thanks! it works, with different networks, and 18b works. but the speed compared to eigen, eigenavx2 1.11.0 is tens times slower. something's wrong. :sad:

visits: 1
10b eigen 1.11 Time taken: 0.281
10b your file Time taken: 15.21

60b eigen 1.11 Time taken: 2.605
60b your file Time taken: 160.166

18b your file Time taken: 56.941
Last edited by And on Sun Nov 27, 2022 10:40 am, edited 1 time in total.
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

second game KataGo 18b, playouts 10 - 60b, playouts 10
(60b-s665)

Attachments
18b - 60b.sgf
(1.1 KiB) Downloaded 1637 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

KataGo 18b, playouts 100 - CS Zero 9d H4

Attachments
KataGo - CS Zero.sgf
(1.7 KiB) Downloaded 1614 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

KataGo 18b, playouts 100 - CS Zero 9d H5
after 347 moves CS Zero: winrate 64.3, B+32

Attachments
KataGo - CS Zero.sgf
(2.32 KiB) Downloaded 1604 times
PC_Screen
Beginner
Posts: 17
Joined: Sat Sep 10, 2022 6:03 am
GD Posts: 0
Has thanked: 1 time
Been thanked: 10 times

Re: KataGo Distributed Training and new networks

Post by PC_Screen »

New KataGo 18b out, supposed to as strong as 60b at equal visits while also being faster than 40b, which means it should be stronger than both in an actual game.

https://cdn.discordapp.com/attachments/ ... 21b.bin.gz

Also test game: KataGo 1.11 18b (W) vs KataGo 1.3.5 40b (B) with 2H and 0.5 Komi, Japanese Rules. The time setting is 10s/move for both which gave them around 1-2k visits per move on average.



The new 18b KataGo managed a convincing win against a 2 year old KataGo despite the 2 handicap stones.
Attachments
KataGo 135 40B vs Katago 111 18B - 2H - W + R.sgf
(375.97 KiB) Downloaded 1630 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

"UEC finished this weekend...KataGo placed 2nd in the final (and first in the preliminaries)." https://discord.com/channels/4170221623 ... 4930181303
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

KataGo (18b-uec, playouts 1) - CS Zero 9d

Attachments
KataGo - CS Zero.sgf
(1016 Bytes) Downloaded 1605 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

100 games 19x19 KataGo 18b-uec (playouts 1) - 60b-s665 (playouts 1):
18b (B) - 60b (W) 21:29
18b (W) - 60b (B) 26:24
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

100 games 19x19 KataGo 18b-uec (playouts 2) - 60b-s665 (playouts 1):
18b (B) - 60b (W) 32:18
18b (W) - 60b (B) 35:15
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

10 games KataGo 18b-uec (playouts 10) - 60b-s665 (playouts 5):
18b (W) - 60b (B) 8:2

Attachments
18b - 60b.sgf
(1.5 KiB) Downloaded 1561 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

10 games KataGo 18b-uec (playouts 10) - 60b-s665 (playouts 5):
18b (B) - 60b (W) 9:1

Attachments
18b - 60b.sgf
(1023 Bytes) Downloaded 1541 times
And
Gosei
Posts: 1464
Joined: Tue Sep 25, 2018 10:28 am
GD Posts: 0
Has thanked: 212 times
Been thanked: 215 times

Re: KataGo Distributed Training and new networks

Post by And »

in the position from here viewtopic.php?p=244851#p244851, I turned on the analysis mode, the network 18b-uec. the move h1 was immediately highlighted. after ~200 visits, katago showed white winning, but then decided that there no winning and the winrate continued to fall :o
EDIT after 10K visits - 39.4
Click Here To Show Diagram Code
[go]$$Wc White to play
$$ ---------------------------------------
$$ | . . . . . . . . . . . . . . . . . . . |
$$ | . . . . . . O . . X . . . . . . . . . |
$$ | . X O O . . . X X O X X X . X X X . . |
$$ | . . X , O . O X O O . O . . . O X O . |
$$ | . X . X X X O O X O . . . . . . . . . |
$$ | . . O . . . O . X O . . X . . . O . . |
$$ | . . . . . O . . X . O O X . . O . . . |
$$ | . . X . . . O X X X O X X . X O . . . |
$$ | . . . . . . O O X O O X . O . X O . . |
$$ | . . . , . . O O O X X O . . . X O . . |
$$ | . . . . . . X O O X . O . . . X . . . |
$$ | . . O . . X . X X X O . . . . . X . . |
$$ | . . . . . X O . . X . . . . . . . . . |
$$ | . . . X . X O O O X . . . . . . . . . |
$$ | . . X O X X X O X O . O . . . . O . . |
$$ | . . O O O . X O X O . . . O . O . O . |
$$ | . . . O . O O X X O . . X X X X O X . |
$$ | . . . . . . X . . . . . . . . . X . . |
$$ | . . . . . . . . . . . . . . . . . . . |
$$ ---------------------------------------[/go]
Post Reply