Thanks for your patience, I had to find time to figure out some of the command-line details. Here is my process, followed by what I think are the relevant results. Any comments/interpretation is welcome.
1. I downloaded the current relevant version of katago, katago-v1.6.1-gpu-opencl-windows-x64.zip
2. Downloaded this neural net [331M] g170-b40c256x2-s5095420928-d1229425124.zip
recommended as the strongest 40-block, from
https://d3dndmfyhecmj0.cloudfront.net/g ... index.html3. after putting the net in a folder alongside katago, ran the configuration process:
.\katago.exe genconfig -model nn/model.bin.gz -output gtp_custom.cfg
-made a few arbitrary decisions: Japanese rules default; 12gb cache budget (3gb is default)
-as I understand it, the process also tested my PC and returned the config file, gtp_custom.cfg
4. ran the command
.\katago benchmark -model 'nn/model.bin.gz' -config 'gtp_custom.cfg'
with results below.
Note, I could hear the PC working extra hard during the benchmark testing.
****************************
Ordered summary of results:
numSearchThreads = 5: 10 / 10 positions, visits/s = 390.12 nnEvals/s = 341.84 nnBatches/s = 137.46 avgBatchSize = 2.49 (20.6 secs) (EloDiff baseline)
numSearchThreads = 8: 10 / 10 positions, visits/s = 483.20 nnEvals/s = 426.08 nnBatches/s = 107.48 avgBatchSize = 3.96 (16.7 secs) (EloDiff +68)
numSearchThreads = 10: 10 / 10 positions, visits/s = 475.83 nnEvals/s = 418.13 nnBatches/s = 84.81 avgBatchSize = 4.93 (17.0 secs) (EloDiff +55)
numSearchThreads = 12: 10 / 10 positions, visits/s = 532.33 nnEvals/s = 471.48 nnBatches/s = 79.88 avgBatchSize = 5.90 (15.2 secs) (EloDiff +91)
numSearchThreads = 16: 10 / 10 positions, visits/s = 583.43 nnEvals/s = 518.51 nnBatches/s = 66.15 avgBatchSize = 7.84 (14.0 secs) (EloDiff +113)
numSearchThreads = 20: 10 / 10 positions, visits/s = 420.69 nnEvals/s = 381.50 nnBatches/s = 39.19 avgBatchSize = 9.73 (19.5 secs) (EloDiff -35)
************************
Also, I did a casual sample of KaTrain 1.4.0 (separate download), in particular its self-play speed for five games, Japanese rules, default settings and after running its own self-configuration by assessing my PC. Times are +-1 sec.
44 s, 301 moves B+0.5
40 s, 239 moves B+0.5
77 s, 300 moves W+31.5
80 s, 310 moves, W+33.5
59 s, 320 moves, W+3.5