It is currently Thu Mar 28, 2024 3:20 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 36 posts ]  Go to page Previous  1, 2
Author Message
Offline
 Post subject: Re: KataGo V1.5
Post #21 Posted: Tue Sep 08, 2020 4:00 pm 
Lives with ko

Posts: 131
Liked others: 0
Was liked: 7
lightvector wrote:
v1.6.0 is out, which now does have a reasonably-performing CPU version, along with a major bugfix in OpenCL for users who has multiple NVIDIA GPUs where it would essentially not be able to use both GPUs in parallel. (@And)

https://github.com/lightvector/KataGo/releases


How strong is KataGo with an AMD Threadripper 3990X?
~1x RTX 2060
~1x RTX 2070
~1x RTX 2080
~1x RTX 2080 Ti


I mean KataGo running only on this CPU (no GPUs).


Last edited by goame on Wed Sep 09, 2020 4:50 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #22 Posted: Tue Sep 08, 2020 9:55 pm 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
From what I have read, for 2 GPUs, there are only slight improvements for more than 16 real CPU cores. Threadripper would only make sense for using 4+ GPUs (say, 3080 or 3090), in which case networking / storage throughput are more decisive and general acceleration might be far below linear (e.g., 3x for 4 GPUs or 5.5x for 8 GPUs). OC, some programs might have better parallelisation. Cooling is also a decisive factor: much space around each GPU is mandatory. A 2000W power supply might, or might not, be enough.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #23 Posted: Tue Sep 08, 2020 10:33 pm 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
lightvector wrote about 2 GPUs and KataGo in https://www.lifein19x19.com/viewtopic.p ... 28#p259528:
"you just use both GPUs. [...] if you have multiple tasks instead of just one, you just give both GPUs different tasks in parallel and get a 2x throughput. In an MCTS search, you always have multiple tasks. Different GPUs can evaluate different nodes in the tree. [However, SLI is not useful.]"

goame wrote in https://www.lifein19x19.com/viewtopic.p ... 83#p258983:
"2x RTX 2080 Ti are ~2x faster than 1x RTX 2080 Ti."

Therefore, I consider building a PC with 1x or 2x Nvidia RTX 3080 (on a mainboard with two PCIe x16 slots being at least three slots apart) and a ca. 12 cores AMD cpu (I know, 16 cores would be better, but also a bit expensive).

Is KataGo the only program using multiple GPUs effectively or what other programs also do it well?

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #24 Posted: Wed Sep 09, 2020 9:49 am 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
goame wrote:
I mean KataGo running only on this CPU (no GPUs).


Seeing your edit, uhm, I have no idea...

Different question: for your 2x 2080 TI, which CPU do you use and to what percentage is it used under load?

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #25 Posted: Wed Sep 09, 2020 1:01 pm 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
goame wrote:
lightvector wrote:
v1.6.0 is out, which now does have a reasonably-performing CPU version, along with a major bugfix in OpenCL for users who has multiple NVIDIA GPUs where it would essentially not be able to use both GPUs in parallel. (@And)

https://github.com/lightvector/KataGo/releases


How strong is KataGo with an AMD Threadripper 3990X?
~1x RTX 2060
~1x RTX 2070
~1x RTX 2080
~1x RTX 2080 Ti


I mean KataGo running only on this CPU (no GPUs).

Ryzen Threadripper 3990X ~3.5 TFlops
GeForce GTX 1060 6GB ~4.4 TFlops
GeForce RTX 2060 ~5.2 TFlops

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #26 Posted: Wed Sep 09, 2020 1:37 pm 
Lives with ko

Posts: 131
Liked others: 0
Was liked: 7
RobertJasiek wrote:
goame wrote:
I mean KataGo running only on this CPU (no GPUs).


Seeing your edit, uhm, I have no idea...

Different question: for your 2x 2080 TI, which CPU do you use and to what percentage is it used under load?


6 core CPU and 33% under load.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #27 Posted: Wed Sep 09, 2020 1:44 pm 
Lives with ko

Posts: 131
Liked others: 0
Was liked: 7
And wrote:
goame wrote:
lightvector wrote:
v1.6.0 is out, which now does have a reasonably-performing CPU version, along with a major bugfix in OpenCL for users who has multiple NVIDIA GPUs where it would essentially not be able to use both GPUs in parallel. (@And)

https://github.com/lightvector/KataGo/releases


How strong is KataGo with an AMD Threadripper 3990X?
~1x RTX 2060
~1x RTX 2070
~1x RTX 2080
~1x RTX 2080 Ti


I mean KataGo running only on this CPU (no GPUs).

Ryzen Threadripper 3990X ~3.5 TFlops
GeForce GTX 1060 6GB ~4.4 TFlops
GeForce RTX 2060 ~5.2 TFlops


This is very interesting.
The 4990X which should be available in the next time, could be as strong as the RTX 2060.
5990X could be like one RTX 2080 Ti.
Maybe it starts to make sense to use GPUs and CPUs when running KataGo?

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #28 Posted: Thu Sep 10, 2020 6:51 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
another source https://www.techpowerup.com/cpu-specs/r ... 990x.c2271
AMD Ryzen Threadripper 3990X - 13,209.6 GFLOPS

GeForce RTX 2080 Ti - 13,448 GFLOPS

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #29 Posted: Thu Sep 10, 2020 7:00 am 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
3990x = 3 *2080Ti

costs

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #30 Posted: Thu Sep 10, 2020 7:04 am 
Gosei
User avatar

Posts: 1348
Liked others: 202
Was liked: 203
and besides that, it is not known what the difference will be in a particular application :)

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #31 Posted: Fri Sep 11, 2020 9:20 am 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
goame wrote:
6 core CPU and 33% under load.


Thanks. I have got another question on your 2 graphics cards:

Do they run on PCIe 3.0 each at x8?

Now, PCIe 4.0 is available but I cannot find a motherboard with dual x16 (for both graphics cards). Do CPUs not support enough lanes yet?

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #32 Posted: Fri Sep 11, 2020 10:02 am 
Lives with ko

Posts: 131
Liked others: 0
Was liked: 7
RobertJasiek wrote:
goame wrote:
6 core CPU and 33% under load.


Thanks. I have got another question on your 2 graphics cards:

Do they run on PCIe 3.0 each at x8?

Now, PCIe 4.0 is available but I cannot find a motherboard with dual x16 (for both graphics cards). Do CPUs not support enough lanes yet?


I'm using this one: https://www.amazon.de/X79A-GD45-Mainboa ... B00704JT42

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #33 Posted: Fri Sep 11, 2020 10:50 am 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
The MSI webpage does not clarify. According to the manual of your motherboard, slots 1 and 4 support up to PCIe 3.0 x16 and allow SLI. The manual is not explicit about speed in the case of dual use. Implicitly, it suggests x16 for each because slot 4 is not used in single use but allows up to x16, which only could occur in multiple use. The motherboard is for 2nd generation Core i, for which the best CPUs provide 40 lanes, like nowadays I think. Since some lanes are used for storage and ports, I guess that the actual dual use speed is x8 or x16 + x8.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #34 Posted: Fri Sep 11, 2020 11:43 am 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
I looked for a too low hanging fruit;) Gigabyte X299X AORUS XTREME WATERFORCE is some motherboard running up to 3 cards each at x16...! The socket is LGA2066, a typical CPU is Core i9-10980XE for a modest €1.000 and TDP 165W. Ok, so in principle it is possible. For more realistic options, one must search more extensively or compromise on 2x PCIe 4.0 x8 speed, losing something between 0% and 20% application speed?

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #35 Posted: Sat Sep 12, 2020 1:27 pm 
Judan

Posts: 6087
Liked others: 0
Was liked: 786
RobertJasiek wrote:
your motherboard [...] CPUs provide 40 lanes


Meanwhile I have learned that chipsets can provide additional PCIe lanes so your motherboard might indeed have 2x PCI 3.0 x16.

Top
 Profile  
 
Offline
 Post subject: Re: KataGo V1.5
Post #36 Posted: Mon Sep 28, 2020 4:55 am 
Lives with ko

Posts: 150
Liked others: 200
Was liked: 30
Rank: 25 kyu
kata 1.61 s509 40b 1 thread 9 po vs gtp4zen 9d zen7

4:0

9 playouts > 9 dan gtp4zen nice!

attached 1 sgf (1.sgf)
edit: also 4-0 at 6 playouts but didnt include sgfs, attached two-gtp screenshot
Attachment:
Screenshot_20201101-131820.png
Screenshot_20201101-131820.png [ 524.88 KiB | Viewed 4183 times ]


6b 1 playout 1 thread vs gnugo 3.8 default settings (level 10?) 12-0
6b 1 playout vs zen 6 (real program, not gtp4zen) 3k 1-0 as black.
Attachment:
6b1poVSzen63k.sgf [957 Bytes]
Downloaded 276 times

was not very close the 6b policy can probably beat zen6 at a higher level. I was really surprised, I respect zen 6 strength alot.


Attachments:
1.sgf [1.93 KiB]
Downloaded 285 times
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 36 posts ]  Go to page Previous  1, 2

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group