Page 1 of 9
A new run of KataGo released - strength comparable to ELFv2
Posted: Tue Jun 18, 2019 5:20 am
by veikko
Re: A new run of KataGo released - strength comparable to EL
Posted: Tue Jun 18, 2019 4:52 pm
by lightvector
Summary:
* New run learns twice as fast as the old LZ130 run and now reaches ELFv2 level at visit parity in about 19 days, and using no more than 27 GPUs for most of the run (19 for early parts, 28 briefly) instead of hundreds or thousands as in Leela Zero/ELF/AlphaZero. Self-play games and training data all released:
https://d3dndmfyhecmj0.cloudfront.net/g104/index.html
* Major steps forward on OpenCL and Windows support. More work still to be done, I'm working on it.
* The OpenCL/Windows issue aside, should work fine with Lizzie and other tools at this point (and if not, I should be able to make any fixes quickly and easily if it's just a matter of outputting the data the right way for a tool to read). Capable of also predicting final score and territory heatmap, as soon as any tool wants to add support for how that tool wants to display it.
* Still have many research ideas for how to continue to improve it. I'll be continuing to test these these ideas over the next months, and if any of these ideas test out well, we should be able to do an even better third run.
I'm happy to answer any questions or whatever. Yay.
Re: A new run of KataGo released - strength comparable to EL
Posted: Wed Jun 19, 2019 3:33 pm
by spook
@lightvector
Wanted to congratulate you and the entire KataGo team with the 1.1 release.
I am convinced that it will have a big impact on the AI study tools.
Installed it this evening on an ubuntu test server. Looks promising.
Will play around with it in the coming days.
PS: are you also "@lightvector" on twitter ?
Re: A new run of KataGo released - strength comparable to EL
Posted: Wed Jun 19, 2019 11:16 pm
by lightvector
Thanks! Seems like the main big remaining obstacles to usability are Windows support and CUDA dependence. Hope to address both of those over the next few weeks.
No, I am not on Twitter at all.
Re: A new run of KataGo released - strength comparable to EL
Posted: Thu Jun 20, 2019 5:39 am
by Bonobo
Very exciting … any chance we can get this for macOS?
Posted: Thu Jun 20, 2019 1:35 pm
by EdLee
... for macOS?
Or an OS-indep browser version like deepleela or zbaduk (
greedy 
)
Re:
Posted: Thu Jun 20, 2019 4:31 pm
by Bonobo
EdLee wrote:... for macOS?
Or an OS-indep browser version like deepleela or zbaduk (
greedy )
… or
http://leela-one-playout.herokuapp.com/ (had to add it to the list)
Re: A new run of KataGo released - strength comparable to EL
Posted: Thu Jun 20, 2019 5:33 pm
by lightvector
Bonobo wrote:Very exciting … any chance we can get this for macOS?
I have a friend who I think has managed to compile it for mac already, so I think the answer is already yes? Let me know if you run into problems, happy to troubleshoot. If you're looking for pre-compiled executables, I'll try to figure that out once the OpenCL implementation is fast enough for real use, since figuring out how to link with CUDA and deal with CUDNN is a headache, even sometimes right on the same OS I do all my development on (linux).
Well, I hope whatever dev or devs like to develop sites like that in their spare time find KataGo worth picking up.
Re: A new run of KataGo released - strength comparable to EL
Posted: Thu Jun 20, 2019 6:05 pm
by Bonobo
lightvector wrote:I have a friend who I think has managed to compile it for mac already, so I think the answer is already yes? Let me know if you run into problems, happy to troubleshoot.
Oh wow, sounds good … but meanwhile I’m elderly and not so adventurous as I once was … so, I’ll wait for click-ready executables
Well, I hope whatever dev or devs like to develop sites like that in their spare time find KataGo worth picking up.
Why not talk to Andreas M. Hauenstein about it? His mail address is on the “About” page.
Re: A new run of KataGo released - strength comparable to EL
Posted: Fri Jun 21, 2019 7:16 am
by bernds
I've pushed some code to the q5go github to support kata-analyze and save/display the score data it reports (it's added to the comment in batch analysis, and the evaluation graph now has a context menu item to switch between score and win rate).
Re: A new run of KataGo released - strength comparable to EL
Posted: Fri Jun 21, 2019 5:40 pm
by splee99
Compared to ELFv2, Katago's handicap game style is really the best. It can play 5 handicap games ( I haven't test more handicaps yet) without any bad moves (remember ELF's ladder moves?).
Re: A new run of KataGo released - strength comparable to EL
Posted: Sat Jun 22, 2019 1:34 pm
by splee99
Here is a 4 stone handicap game with Leela 0.11 with 20 second per move time setting. With the same time setting Leela Zero 40b weights have only small chance to win in 3 handicap games. The obvious style of Katago is that it likes to cut and deal with multiple groups properly. It even outsmarts Leela 0.11 in ladder reading.
Re: A new run of KataGo released - strength comparable to EL
Posted: Thu Jun 27, 2019 6:32 pm
by hoa803
Here is an example of a fascinating game between LZ and KataGo I played out tonight in Sabaki while working out. Hey, gotta watch something, right? It's like baduk TV!
The hardware was:
AMD Ryzen 2600x
NVIDIA RTX 2060
The settings were as follows:
KataGo 1.1
Code: Select all
C:\KataGo\main.exe
gtp -model C:\KataGo\20b.txt -config C:\KataGo\configs\gtp_example.cfg
time_settings 0 16 1
(all default except numSearchThreads = 16, cudaUseFP16 = true, cudaUseNHWC = true, no limits on playouts/visits, ponderingEnabled = false)
Leela Zero #226
Code: Select all
C:\LeelaZero\LZ017\leelaz.exe
--gtp -r 5 -w C:\LeelaZero\networks\LZ226.gz --noponder
time_settings 0 16 1
I made the first four moves myself, because I didn't want to watch a bunch of 3-3 invasions this time. The game features an early ko and a complicated fight in the center that decides the entire game. Neither engine was sure who was winning until the very end.
Re: A new run of KataGo released - strength comparable to EL
Posted: Thu Jun 27, 2019 7:33 pm
by lightvector
I find high level bot v bot games both confusing and amazing. The midgame fights that break out can become so complicated.
Re: A new run of KataGo released - strength comparable to EL
Posted: Mon Jul 01, 2019 2:46 am
by Bill Spight
Marcel Grünauer wrote:As far as I understand, KataGo needs CUDA/CuDNN, which requires NVIDIA GPUs, so there might be no way to run the current version of KataGo on Apple hardware (macOS or any other OS), since Macs use Radeon GPUs.
FWIW, my 2014 Macbook Pro has an NVIDIA GPU:
"Chipset Model: NVIDIA GeForce GT 750M"