A new run of KataGo released - strength comparable to ELFv2

[veikko]

https://www.reddit.com/r/cbaduk/comment ... and_other/

https://github.com/lightvector/KataGo/releases/tag/v1.1

[lightvector]

Summary:

* New run learns twice as fast as the old LZ130 run and now reaches ELFv2 level at visit parity in about 19 days, and using no more than 27 GPUs for most of the run (19 for early parts, 28 briefly) instead of hundreds or thousands as in Leela Zero/ELF/AlphaZero. Self-play games and training data all released: https://d3dndmfyhecmj0.cloudfront.net/g104/index.html

* Major steps forward on OpenCL and Windows support. More work still to be done, I'm working on it.

* The OpenCL/Windows issue aside, should work fine with Lizzie and other tools at this point (and if not, I should be able to make any fixes quickly and easily if it's just a matter of outputting the data the right way for a tool to read). Capable of also predicting final score and territory heatmap, as soon as any tool wants to add support for how that tool wants to display it.

* Still have many research ideas for how to continue to improve it. I'll be continuing to test these these ideas over the next months, and if any of these ideas test out well, we should be able to do an even better third run.

I'm happy to answer any questions or whatever. Yay.

[spook]

@lightvector
Wanted to congratulate you and the entire KataGo team with the 1.1 release.
I am convinced that it will have a big impact on the AI study tools.

Installed it this evening on an ubuntu test server. Looks promising.
Will play around with it in the coming days.

PS: are you also "@lightvector" on twitter ?

[lightvector]

Thanks! Seems like the main big remaining obstacles to usability are Windows support and CUDA dependence. Hope to address both of those over the next few weeks.

No, I am not on Twitter at all.

[Bonobo]

Very exciting … any chance we can get this for macOS?

[EdLee]

... for macOS?

Or an OS-indep browser version like deepleela or zbaduk ( greedy )

[Bonobo]

... for macOS?

Or an OS-indep browser version like deepleela or zbaduk ( greedy )

… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)

[lightvector]

Very exciting … any chance we can get this for macOS?

I have a friend who I think has managed to compile it for mac already, so I think the answer is already yes? Let me know if you run into problems, happy to troubleshoot. If you're looking for pre-compiled executables, I'll try to figure that out once the OpenCL implementation is fast enough for real use, since figuring out how to link with CUDA and deal with CUDNN is a headache, even sometimes right on the same OS I do all my development on (linux).

… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)

Well, I hope whatever dev or devs like to develop sites like that in their spare time find KataGo worth picking up.

[Bonobo]

I have a friend who I think has managed to compile it for mac already, so I think the answer is already yes? Let me know if you run into problems, happy to troubleshoot.

Oh wow, sounds good … but meanwhile I’m elderly and not so adventurous as I once was … so, I’ll wait for click-ready executables

… or http://leela-one-playout.herokuapp.com/ (had to add it to the list)

Well, I hope whatever dev or devs like to develop sites like that in their spare time find KataGo worth picking up.

Why not talk to Andreas M. Hauenstein about it? His mail address is on the “About” page.

[bernds]

I've pushed some code to the q5go github to support kata-analyze and save/display the score data it reports (it's added to the comment in batch analysis, and the evaluation graph now has a context menu item to switch between score and win rate).

[splee99]

Compared to ELFv2, Katago's handicap game style is really the best. It can play 5 handicap games ( I haven't test more handicaps yet) without any bad moves (remember ELF's ladder moves?).

[splee99]

Here is a 4 stone handicap game with Leela 0.11 with 20 second per move time setting. With the same time setting Leela Zero 40b weights have only small chance to win in 3 handicap games. The obvious style of Katago is that it likes to cut and deal with multiple groups properly. It even outsmarts Leela 0.11 in ladder reading.

kata-l-20s-b.sgf

(2.28 KiB) Downloaded 3190 times

[hoa803]

Here is an example of a fascinating game between LZ and KataGo I played out tonight in Sabaki while working out. Hey, gotta watch something, right? It's like baduk TV!

The hardware was:
AMD Ryzen 2600x
NVIDIA RTX 2060

The settings were as follows:

KataGo 1.1

Code: Select all

C:\KataGo\main.exe
gtp -model C:\KataGo\20b.txt -config C:\KataGo\configs\gtp_example.cfg
time_settings 0 16 1
(all default except numSearchThreads = 16, cudaUseFP16 = true, cudaUseNHWC = true, no limits on playouts/visits, ponderingEnabled = false)

Leela Zero #226

Code: Select all

C:\LeelaZero\LZ017\leelaz.exe
--gtp -r 5 -w C:\LeelaZero\networks\LZ226.gz --noponder
time_settings 0 16 1

I made the first four moves myself, because I didn't want to watch a bunch of 3-3 invasions this time. The game features an early ko and a complicated fight in the center that decides the entire game. Neither engine was sure who was winning until the very end.

[lightvector]

I find high level bot v bot games both confusing and amazing. The midgame fights that break out can become so complicated.

[Bill Spight]

As far as I understand, KataGo needs CUDA/CuDNN, which requires NVIDIA GPUs, so there might be no way to run the current version of KataGo on Apple hardware (macOS or any other OS), since Macs use Radeon GPUs.

FWIW, my 2014 Macbook Pro has an NVIDIA GPU:

"Chipset Model: NVIDIA GeForce GT 750M"