Getting KataGo to run on multi GPU rig

[PondTurtle]

I tried to config KataGo so it uses both of my GTX GPUs but even reading through the config file and doing my best to set it as instructed it keeps stubbornly only using one for pondering in Lizzie.

Could anybody maybe show me how it is supposed to look? Thanks

[lightvector]

Set numNNServerThreadsPerModel = 2 ("I want 2 GPU threads")
Set cudaGpuToUseThread0 = 0 ("Thread 0 should use GPU 0")
Set cudaGpuToUseThread1 = 1 ("Thread 1 should use GPU 1")

Or do the analogous thing for OpenCL if you're using OpenCL.

[PondTurtle]

Thank you. That did it. Turns out I had it right but I was editing the wrong file

[Vargo]

20-game match katago1.2(1x1080Ti) v. katago1.2 (2x1080Ti)
9x9 , -time 1s+3s/1 (=3 sec/move), komi 7.5, noponder, network 20x256
(same program, network and parameters, only difference is 1 or 2 GPU)
no error, no duplicate game
katago 2GPU wins 13-7 (65%)


20-game match katago1.2(1x1080Ti) v. katago1.2 (2x1080Ti)
19x19, 5 min per game, komi 7.5, noponder, network 20x256
no error, no duplicate game
katago 2GPU wins 14-6 (70%)


Stats : (gogui twogtp 1.5.1 , katago 2GPU shows always as W, because of -alternate)

9.jpg (405.94 KiB) Viewed 4204 times

19.jpg (406.96 KiB) Viewed 4204 times