Life In 19x19 http://www.lifein19x19.com/ |
|
KaTrain Questions http://www.lifein19x19.com/viewtopic.php?f=18&t=19175 |
Page 2 of 3 |
Author: | Cassandra [ Sun Jun 04, 2023 3:58 am ] |
Post subject: | Re: KaTrain Questions |
RobertJasiek wrote: I prefer the best AI play immediately. This is the attitude of high dans. (As a mathematician, only 100% correctness is valid. 97% is not mathematics but statistics;) ) Dear Robert, You do not really understand! The percentages referred to the realisation of your presumed requirements / needs, not to the quality of KataGo's statements (which also rely on statistics, by the way ). Even the "best" AI play will NEVER ALWAYS deliver "100% correctness", whatever you may understand by "correctness" (the best move in relation to the prospect of winning, the best move in relation to the size of the game's outcome, ...). In the majority of cases, KataGo's objectives will NOT be yours. And please always remember that KataGo (no matter how strong the network used is) will most likely NOT play "correctly" in positions that the network used has not worked through sufficiently during training (at least you cannot be sure that KataGo does). And I firmly believe that you have many positions of this type to be investigated up your sleeve. IH120 is the most striking example. For example, my IH120-60b (currently still) hallucinates changes in the order of moves where in fact there are none (i.e. no valid ones). And often it requires the gracious assistance of Karl's IH120-40b to determine that. Do you know a valid solution for all the positions you want to investigate? For IH120 we already know some, which is incredibly helpful in the current phase of my IH120-60b training. First of all, it is eminently important for you to gain experience. And that will be sufficiently possible with ANY strong KataGo network, even with the parameters' DEFAULT values! |
Author: | RobertJasiek [ Sun Jun 04, 2023 4:25 am ] |
Post subject: | Re: KaTrain Questions |
Cassandra wrote: Even the "best" AI play will NEVER ALWAYS deliver "100% correctness" The joke has been beyond your perception... Quote: First of all, it is eminently important for you to gain experience. Your approach is not mine. For me, I prefer good settings before gaining experience. Besides, I would prefer not having to reinvent the wheel by rediscovering everything other Katago users might already have discovered as to executables, drivers and settings. AI usage should not be alchemy but should be readily applicable. |
Author: | Cassandra [ Sun Jun 04, 2023 4:53 am ] |
Post subject: | Re: KaTrain Questions |
RobertJasiek wrote: Quote: First of all, it is eminently important for you to gain experience. Your approach is not mine. For me, I prefer good settings before gaining experience. Besides, I would prefer not having to reinvent the wheel by rediscovering everything other Katago users might already have discovered as to executables, ...You could already read that the benefit of a TensorRT installation may not justify the additional effort required for it. You should start with CUDA anyway, so why not stick with it (for now)? Quote: ... drivers ... If you are missing any, KataGo will not run. Usually there are also corresponding messages on the screen. Quote: ... and settings. Do you know anyone else in this world who shares your needs / demands? So try it first and then let us know what didn't go as planned. |
Author: | RobertJasiek [ Sun Jun 04, 2023 5:08 am ] |
Post subject: | Re: KaTrain Questions |
Cassandra wrote: You could already read that the benefit of a TensorRT installation may not justify the additional effort required for it. No, but I could read two types of opinions, the other being: TensorRT is about 1.5 as fast on my GPU, and may or may not be stronger depending on the position and net. Quote: You should start with CUDA anyway Will do. Quote: so why not stick with it (for now)? Because TensorRT can be about 1.5 as fast. If it were 1.005, I might not care but 1.5 is extraordinarily better. Quote: Quote: ... drivers ... If you are missing any, KataGo will not run. Usually there are also corresponding messages on the screen. Ok, this is a useful hint. Quote: Do you know anyone else in this world who shares your needs / demands? Personalised meta-discussion leads nowhere. As a broader meta-discussion, every user needs to decide between OpenCL, CUDA, Tensor and Eigen, would profit from 1.5x speed, and would profit from choosing good settings and nets with ease and confidence of sufficient understanding. |
Author: | xela [ Mon Jun 05, 2023 2:53 am ] |
Post subject: | Re: KaTrain Questions |
Robert, you're recapitulating a debate that's been going on in academic circles since the 1980s. Unfortunately, "statistics and alchemy" is actually a pretty good description of machine learning. It's an empirical practice, not an exact science. It certainly isn't a branch of pure mathematics. See https://projecteuclid.org/journals/stat ... 13726.full if you're interested in the philosophy. I'd strongly recommend that you get KataGo using your GPU in the simplest way possible, spend a few weeks using it to explore go positions, and then make a decision on whether it's worth optimising the performance. RobertJasiek wrote: 1) Have I already installed CUDA drivers as part of the Nvidia Studio driver? "Drivers" isn't quite the right term. CUDA is a software library for GPUs. No, most likely you will need to install it. Type "install CUDA windows" or similar into your favourite search engine, and find a set of instructions that make sense to you. Ditto cuDNN and TensorRT, if you want/need to go ahead and install them. But I'd leave this for later. RobertJasiek wrote: 9) (How) can I see in process or Nvidia tools whether a running Katago process uses OpenCL, CUDA or tensor cores? I'm on Linux, and I believe you're on Windows, so I can't give you the exact answer. But you probably can't, because OpenCL/CUDA/TensorRT refer to software, while the Nvidia tools will only tell you what the hardware is doing. I expect the graphics card drivers would include some sort of status monitor to show which processes are using the GPU, how much GPU memory is allocated to each one, etc. It won't be in the Windows task manager though, but somewhere else. Browse through your system tray and control panels. Or google for advice :-) If you run katago from a command line, it will display a lot of status information, including which backend it's using. This may or may not be useful! RobertJasiek wrote: 10) How do I assess whether some Katago tuning parameters are better than others on my PC? Using the same network and the same board position, different tuning parameters will give you different numbers of playouts per second. Higher numbers are better. RobertJasiek wrote: 11) How do I see numbers of playouts? Yes, good question. I just opened up katrain for the first time in a while, and remembered why I prefer to use Lizzie. The Lizzie status bar shows both total playouts and playouts per second. I haven't found how to do this in katrain. Hopefully someone else is reading this and can answer. |
Author: | Cassandra [ Mon Jun 05, 2023 3:57 am ] |
Post subject: | Re: KaTrain Questions |
xela wrote: CUDA is a software library for GPUs. No, most likely you will need to install it. Type "install CUDA windows" or similar into your favourite search engine, and find a set of instructions that make sense to you. Ditto cuDNN and TensorRT, if you want/need to go ahead and install them. According to my experience, you will have to make sure that ALL directories that contain the DLL's from these software libraries are known to your system via the PATH environment variable. You will have to add some of these manually (Google will help you with this), if this has not already been done by the respective installation programme. Quote: But I'd leave this for later. I'd strongly recommend that you get KataGo using your GPU in the simplest way possible, spend a few weeks using it to explore go positions, and then make a decision on whether it's worth optimising the performance. I second this. + + + + + + + + + + Most likely, you will (also) want to use KataGo to confirm your theories or to gain new insights into them. In the process, as I have already mentioned, you will run into challenges that have NOTHING to do with performance. The more "unusual" the position you want to investigate, the higher the probability that KataGo will have to rely on its "global" Go knowledge only. KataGo will still play super-strong, but NOT as well and reliably as if the network used had sufficiently researched this (type of) position in its training phase. In the games of my IH120-60b against Karl's IH120-40b, it may well happen that 60b has (sometimes noticeably) more playouts than 40b (per adjusted time unit, because 60b is by principle only half as fast as 40b). In my estimation, this is an indication that 60b is more familiar (from the training) with the corresponding position than 40b. In individual cases, this may well result in 40b being "fooled". And this happens even though 60b is little trained compared to 40b and usually has no chance against 40b. Mainly because 60b currently still has the assessment that White will clearly win, and consequently tries avoidance strategies that naturally end in disaster. In the time of Karl's 40b project, we have noticed that KataGo seems to have a strange preference for Triple-Ko, which is of course not so optimal in cases where one should correctly settle for a Double-Ko. (Disclaimer: we do not know to what extent this is specific to IH120 only.) |
Author: | RobertJasiek [ Mon Jun 05, 2023 4:58 am ] |
Post subject: | Re: KaTrain Questions |
xela wrote: CUDA is a software library for GPUs. [...] OpenCL/CUDA/TensorRT refer to software For three years, I have watched Youtube videos and read tech webpages on graphics cards. Everybody told that they have CUDA cores, tensor cores and other cores. Nobody there has ever mentioned that whatever cores could not be simply used by some softwares. Therefore, apparently naively I expected that the Nvidia either Gaming or Studio drivers would simply enable all software to use whichever cores it prefers to use. On my ordinary PC, the iGPU uses several drivers, among which is C:\Windows\System32\OpenCL.dll. Therefore OpenCL can be both a driver and a software. Now, from your explanations, I start to understand that there are CUDA cores, and CUDA or CuDNN software, for which Nvidia also refers to as containing more drivers. Similarly, there seem to be tensor cores and TensorRT software. Hence I guess that KataGo might rely on drivers and dynamically linked software of Nvidia's software packages for CUDA cores and / or tensor cores. I see, so the softwares mentioned in Youtube videos and on ordinary webpages might not be sufficiently advanced to need Nvidia's software packages while machine learning software, such as KataGo, is more advanced in its software design and needs them. I hope I understand this roughly right. |
Author: | RobertJasiek [ Mon Jun 05, 2023 5:19 am ] |
Post subject: | Re: KaTrain Questions |
Cassandra wrote: Most likely, you will (also) want to use KataGo to confirm your theories or to gain new insights into them. You must distinguish my theories by their natures. 1) Mathematical theory established as proved theorems: I do not need any AI ever to confirm such theory because it is already established truth due to the proofs. We can only study whether AI is able to reach the same level of 100% correctness for those situations to which the theorems apply or whether AI does (much) worse. 2) Other go theory formulated as principles, methods or values for which there is a high correlation to professional / strong players' play: We can study whether AI agrees or how / when it disagrees. 3) Other go theory formulated as principles, methods or values that is useful to some extent but does not have a high correlation to professional / strong players' play: Our study of human or AI play might enable improved theory. Apart from theory, there are also example positions for which I want to see whether AI "analyses" better than I have done. In particular, I am curious about my triple ladder analysis for a pro game's position. Will AI even be able to construct the complete ladders? |
Author: | RobertJasiek [ Tue Jun 06, 2023 5:49 am ] |
Post subject: | Re: KaTrain Questions |
After a break, I have touched KaTrain again and changed the executable from <path>\lizzie\katago.exe to <path>\lizzie\katago_cuda.exe. This has been enough to run the latter. By name, I guess this means it is the CUDA version of KataGo. Of course, I do not trust names and have studied running files, processes and drivers in ProcessExplorer and Explorer as below. However, first let me observe the different behaviours of the graphics card as to GPU and VRAM loads as follows. The CUDA version uses a bit more VRAM but loads the GPU more efficiently. Code: Item katago katago_CUDA GPU load 94% 81 ~ 90% VRAM load 1.15GB 1.8 GB Note what I have, or have not installed as follows. Instead of knowing in advance whether the Nvidia Studio drivers and Baduk AI Megapack have, or have not, already installed CUDA drivers and due to missing statements by experienced users, I have had to find out by trial and error that - apparently, I cannot be sure yet - CUDA drivers and CUDA libraries have already been installed. By file names, it appears - but again I cannot be sure yet - that CUDNN libraries have already been installed. I do not know if some of the libraries must be in the same directory as the used katago_cuda.exe. It just happens to be so for the one I have been using so far. However, I cannot know whether this is a necessity. Is it? From the Katago webpage and statements by some experienced users, there has been the strong recommendation to install cuda_12.1.1_531.14_windows.exe and cudnn-windows-x86_64-8.9.2.26_cuda12-archive.zip for CUDA and CUDNN libraries. However, I am not about to program my own neural net, have experienced that unnecessary driver / library installations can corrupt a system (in fact, for my very new PC, I have already experienced this for the AMD iGPU drivers) and it seems that katago_cuda.exe runs without the extra 4GB of installers. Therefore, at least before proceeding to tensor cores, it seems that their installation has been a bad recommendation. And this is what I call alchemy: forcing each go AI user to find out the correct installation procedure by trial and error. Code: NOT INSTALLED YET cuda_12.1.1_531.14_windows.exe Nvidia CUDA installer 3,3GB cudnn-windows-x86_64-8.9.2.26_cuda12-archive.zip Nvidia CUDNN installer-ZIP 0,7GB INSTALLED Baduk_AI_Megapack_v4.18.0_x64.exe Baduk AI Megapack KaTrain Command <path>\lizzie\katago_cuda.exe analysis -model <path>\lizzie\KataGo40b.gz -config <path>\KaTrain\analysis_config.cfg -analysis-threads 12 -override-config homeDataDir=C:\Users\<username>/.katrain Instead, I want to contribute information with which future AI newbies can make more informed decisions than mine. I have observed the following processes, libraries etc. on my new PC, among which many indicate (OpenCL and) CUDA and CUDNN. So if you do not know yet whether you have already installed, or still need to install, such, check for the following files or processes when running katago_cuda.exe: Code: Go AI 64b Processses <path>\KaTrain\KaTrain.exe KaTrain 1.7.2.0 <path>\lizzie\katago_cuda.exe katago_cuda.exe C:\Windows\System32\conhost.exe Host für Konsolenfenster 10.0.22621.1194 Lizzie Katago <path>\lizzie\katago_cuda.exe katago_cuda Lizzie NVIDIA DLLs <path>\lizzie\cublas64_11.dll NVIDIA CUDA BLAS Library 11.7.3.1 <path>\lizzie\cublasLt64_11.dll NVIDIA CUDA BLAS Light Library 11.7.3.1 <path>\lizzie\cudnn_cnn_infer64_8.dll NVIDIA CUDA CUDNN_CNN_INFER Library 11.4.128 <path>\lizzie\cudnn_ops_infer64_8.dll NVIDIA CUDA CUDNN_OPS_INFER Library 11.4.128 <path>\lizzie\cudnn64_8.dll NVIDIA CUDA CUDNN Library 6.5.0 <path>\lizzie\ <contains more CUDA files> Lizzie OpenSSL DLLs <path>\lizzie\libcrypto-1_1-x64.dll OpenSSL library The OpenSSL Project <path>\lizzie\libssl-1_1-x64.dll OpenSSL library The OpenSSL Project Lizzie Misc <path>\lizzie\libz.dll zlib data compression library <path>\lizzie\libzip.dll libzip for Windows <path>\lizzie\ <contains more library files> Nvidia Studio Driver DLLs C:\Windows\System32\nvapi64.dll NVIDIA NVAPI Library 531.61 C:\Windows\System32\nvcuda.dll NVIDIA CUDA Driver 531.61 C:\Windows\System32\ <contains more Nvidia (CUDA) files> C:\Windows\System32\DriverStore\FileRepository\ nv_dispsig.inf_amd64_89cdd9f6f9724565\nvcuda64.dll NVIDIA CUDA Driver 531.61 C:\Windows\System32\DriverStore\FileRepository\ nv_dispsig.inf_amd64_89cdd9f6f9724565\ <contains more Nvidia (CUDA) files> Nvidia System Services C:\Windows\System32\DriverStore\FileRepository\ nv_dispsig.inf_amd64_89cdd9f6f9724565\nvcubins.bin NVIDIA C:\Windows\System32\DriverStore\FileRepository\ nv_dispsig.inf_amd64_89cdd9f6f9724565\Display.NvContainer\NVDisplay.Container.exe NVIDIA Container 1.37.3103.4323 "C:\Windows\System32\DriverStore\FileRepository\ nv_dispsig.inf_amd64_89cdd9f6f9724565\Display.NvContainer\NVDisplay.Container.exe" -f %ProgramData%\NVIDIA\DisplaySessionContainer%d.log -d C:\Windows\System32\DriverStore\FileRepository\ nv_dispsig.inf_amd64_89cdd9f6f9724565\Display.NvContainer\plugins\Session -r -l 3 -p 30000 -cfg NVDisplay.ContainerLocalSystem\Session -c RTX 4070 drivers, extract C:\Windows\System32\drivers\NVIDIA Corporation\Drs\dbInstaller.exe C:\Windows\System32\drivers\NVIDIA Corporation\Drs\nvdrsdb.bin C:\Windows\System32\drivers\NVIDIA Corporation\license.txt C:\Windows\System32\lxss\lib\libcuda.so C:\Windows\System32\lxss\lib\libcuda.so.1 C:\Windows\System32\lxss\lib\libcuda.so.1.1 C:\Windows\System32\lxss\lib\libnvcuvid.so C:\Windows\System32\lxss\lib\libnvcuvid.so.1 C:\Windows\System32\lxss\lib\libnvidia-ml.so.1 C:\Windows\System32\lxss\lib\<various> C:\Windows\System32\MCU.exe C:\Windows\System32\nvapi64.dll C:\Windows\System32\nvcpl.dll C:\Windows\System32\nvcuda.dll C:\Windows\System32\nvcuvid.dll C:\Windows\System32\OpenCL.dll C:\Windows\System32\<various> C:\Windows\SysWow64\<various> C:\Windows\System32\DriverStore\FileRepository\nv_dispsig.inf_amd64_89cdd9f6f9724565\<various> Needless to say, I still have the questions on tensor cores, to start with: have I already been using them? |
Author: | RobertJasiek [ Tue Jun 06, 2023 10:05 pm ] |
Post subject: | Re: KaTrain Questions |
For possible later use, I have downloaded Nvidia's installers / ZIPs for CUDA, CuDNN and TensorRT. The files are not always labelled Windows 11 but sometimes Windows 10. The installation instructions are often outdated referring to older file versions in various combinations. Since I cannot know yet which combination of installers / ZIPs will work, I have downloaded several of their file versions. Once in a lifetime, Nvidia is not at full fault but only at partial fault for its outdated installation instructions and cryptic installer versions. With only 14 minutes download time left, the download of 5 of some dozen files stopped. It has turned out that this is my fault: my download partition got stuck at 0KB remaining space - it was full! At least, Windows kept working flawlessly (maybe because it is not my system partition). So I had to clean up the partition, login to Nvidia's webpage again and start the 5 remaining downloads afresh for another some half an hour. Meanwhile, I have noticed that KataGo 1_13_0 of Baduk AI Megapack is reported to have a bug for tensor cores. So I have also downloaded the install ZIP of KataGo 1_13_1. Plus every installation instructions I could get hold of, of which some address the PATH jobs. Furthermore, I will install a tool listing files of directories so I can protocol any damage further installation might do to some files when older installers might replace newer with older files, because such is exactly what can happen (and has happened in the past). Therefore, I guess I might have every installer / ZIP I possibly need. I think the order of installation is: 1. Nvidia GPU driver (done) 2. Nvidia CUDA version x 3. Nvidia CuDNN for CUDA version x 4. Nvidia TensorRT for CUDA version x 5. If necessary, set Windows system settings | environmental PATHs. Independently, install KataGo 1_13_1. Am I on the right track? Even so, I still do not understand what in KataGo 1_13_1 enables use of tensor cores instead of CUDA cores. In earlier days, there were KataGo installers / ZIPs specific for Tensor[RT] but currently there are not. Is the KataGo 1_13_1 for CUDA also for Tensor[RT]? Is it sufficient to have told Baduk AI Megapack to create the right configuration files for using tensor cores or what, besides the command (line) calling KataGo in KaTrain or another GUI program, do I also need to do to let KataGo actually use tensor cores instead of CUDA cores? |
Author: | lightvector [ Tue Jun 06, 2023 10:42 pm ] |
Post subject: | Re: KaTrain Questions |
* You don't need to do anything to make KataGo use tensor cores, and there's not a great way to be absolutely sure whether it does or not, unless you use OpenCL. The OpenCL version will tell you if it's using tensor cores or not as it runs the tuning the first time you run it. Look at the tuning output as it tunes each operation reporting various performance stats and you'll see a section where it tunes (or fails to tune) for tensor cores and whether or not it decides to use them. The CUDA and TensorRT versions just call Nvidia's libraries and those libraries determine what to do by their own underlying magic, and you just have to trust whatever they are doing. Unlike the OpenCL, KataGo has little to no control over it. If CUDA or TensorRT version runs and works without crashing, then that's probably what you're going to get and that's it. So I recommend not worrying about whether it uses tensor cores or whatever or even trying to find that out because *you* also have little to no control over such low-level details, just benchmark each thing and see what finally gives the best visits/s (./katago.exe benchmark). * KataGo has *always* historically had separate TensorRT and CUDA versions, and the same is true now, it's just that v1.13.0 had a bug with TensorRT (*NOT* a bug with tensor cores, tensor cores and TensorRT are completely different things with no particular relationship to each other), so it got its own release v1.13.1 with a fix, whereas all other versions (OpenCL, Eigen, CUDA) were not because they had no difference. Use TensorRT if you want to attempt Nvidia black magic, which goes beyond even the CUDA version by doing some secret Nvidia proprietary magic optimization of different layers of operations and such, which neither you or I have control over, which if it works, might squeeze out a bit more performance at the cost of much longer startup and loading times. Otherwise, just use whatever version works for you. CUDA is fine if you've installed CUDA. OpenCL is fine too, and has a decent chance of working right out of the box, it comes zipped with all the DLLs already that it should need. * It's been a long time since I tried to install this stuff on Windows. I think that once you have the right drivers, "installation" consists of just having the right DLLs in your path, which are some some CUDA and CUDNN dlls for CUDA, or some DLL with "nvinfer" in the name for TensorRT ("nvinfer" is Nvidia's technical name for TensorRT that it uses for filenames or some technical docs). So, don't trust me on this too much since it's been a while, but I think for example that one could even crudely find the appropriate DLLs from digging into the installation folders and just copy them into the katago executable directory (since Windows also normally considers the local directory of an exe to be a search location for DLLs for that exe). |
Author: | And [ Wed Jun 07, 2023 1:06 am ] |
Post subject: | Re: KaTrain Questions |
in order to run katago-v1.13.1-trt8.5-cuda11.2-windows-x64, I downloaded Lizzieyzy and copied the nvinfer.dll, nvinfer_builder_resource.dll from there. I didn't install anything else. I checked in Sabaki with different networks. it works about twice as fast as opencl for versions v1.12.4. for v1.13 I haven't compared yet Lizzieyzy https://github.com/yzyray/lizzieyzy/releases 2023-01-30-windows64+katago.zip ~1.8gb https://drive.google.com/file/d/1fhad97 ... drive_link |
Author: | RobertJasiek [ Wed Jun 07, 2023 2:38 am ] |
Post subject: | Re: KaTrain Questions |
Thank you both! Now I have something to look for, try and benchmark. If I should install all the Nvidia stuff, I might then fetch the suitable DLLs and put them in KataGo's directory or see if setting PATH does the job. |
Author: | And [ Wed Jun 07, 2023 4:14 pm ] |
Post subject: | Re: KaTrain Questions |
v1.13 katago_tensorRT ~2.2 times faster than katago_opencl (GeForce GTX 1650, b18) |
Author: | RobertJasiek [ Fri Jun 09, 2023 2:31 am ] |
Post subject: | Re: KaTrain Questions |
Suppose C:\katago is my directory to KataGo OpenCL, C:\baduk\katrain is my directory to KaTrain and C:\baduk is my directory of Baduk AI Megapack. Now that I could run KataGo OpenCL, CUDA and TensorRT each in its directory as katago benchmark on the command line, I want to start with KataGo OpenCL in KaTrain in Windows. In C:\katago I run katago.exe genconfig -model b18.bin.gz -output gtp_custom.cfg and answer the questions as follows: KataGo creates gtp_custom.cfg: KataGo creates this LOG file: The command line LOG is: In KaTrain general settings, I set Override with my used model path and name: C:\katago\katago.exe gtp -model 'C:\katago\b18.bin.gz' -config 'C:\katago\gtp_custom.cfg' KataGo Engine Failed: exception: Could not open file 'C:\katago\gtp_custom.cfg' - does not exist or invalid permissions KATAGO-INTERNAL-ERROR The permissions are the same as in C:\baduk\katrain. The three files exist in C:\katago. Is the command syntax correct? If yes, KaTrain might want all files in the same directory. Therefore, my next attempt has been to merge all supposedly necessary files into the same directory C:\baduk\test. Now, in command line I run: C:\baduk\test>katago gtp Now, in command line I run: C:\baduk\test>katago benchmark So the KataGo OpenCL version in C:\baduk\test\katago.exe does run on the command line. However... now, in KaTrain I use C:\baduk\test\katago.exe gtp The following processes with their options are running: Start KaTrain ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'? unknown command' Komi: 6.5 Rules: Japanese I set Black Human - White AI then click a black move. ERROR: <remains as before> Analyzing move... The dGPU has 0% load now. In KaTrain general settings Override, what is the correct command for running a KataGo file, net and CFG that are not already installed in the Baduk AI Megapack directory and its subdirectories? |
Author: | Cassandra [ Fri Jun 09, 2023 6:11 am ] |
Post subject: | Re: KaTrain Questions |
RobertJasiek wrote: In KaTrain general settings, I set Override with my used model path and name: C:\katago\katago.exe gtp -model 'C:\katago\b18.bin.gz' -config 'C:\katago\gtp_custom.cfg' KataGo Engine Failed: exception: Could not open file 'C:\katago\gtp_custom.cfg' - does not exist or invalid permissions KATAGO-INTERNAL-ERROR The permissions are the same as in C:\baduk\katrain. The three files exist in C:\katago. Is the command syntax correct? Why didn't you use ... C:\katago\katago.exe gtp -model C:\katago\b18.bin.gz -config C:\katago\gtp_custom.cfg ??? The use of inverted commas is superfluous, as the directory / file name does NOT contain spaces. If ever, you have to use the following syntax, as far as I know: C:\katago\katago.exe gtp -model "C:\katago\b18.bin.gz" -config "C:\katago\gtp_custom.cfg" |
Author: | RobertJasiek [ Fri Jun 09, 2023 6:21 am ] |
Post subject: | Re: KaTrain Questions |
Thank you, I will try your syntax later today! As to why: I could not find anything in KaTrain manuals yet but only some sample syntax in KataGo manuals with inverted commas. Therefore, I had to test various syntaxes and there are many possible combinations how syntaxes can look. Apparently, I must have missed to test the one you just suggest. |
Author: | RobertJasiek [ Fri Jun 09, 2023 11:47 am ] |
Post subject: | Re: KaTrain Questions |
I have made the following failing attempts to submit a working command to KaTrain. What is the correct syntax? What are my mistakes? What are KaTrain's or KataGo's bugs? ATTEMPT 1 This directory has just Katago 1_13_0 OpenCL. C:\katago\katago.exe gtp -model C:\katago\b18.bin.gz -config C:\katago\gtp_custom.cfg Processes: KaTrain: ERROR line 1 column 1 (char 0). When trying to play: GPU load 0%. ATTEMPT 2 This is my test directory with Katago 1_13_0 OpenCL and all files merged. C:\baduk\test\katago.exe gtp -model C:\baduk\test\b18.bin.gz -config C:\baduk\test\gtp_custom.cfg Click on Update Settings: "KaTrain v.1.12.3 (Keine Rückmeldung)" meaning "KaTrain v.1.12.3 (no reply)" with the process KaTrain <0.01 CPU load Restart KaTrain, General & Engine Settings, press ESC, then these processes are running: KaTrain: ERROR line 1 column 1 (char 0). When trying to play: GPU load 0%. ATTEMPT 3 From now on, I test KaTrain's Override for Baduk AI Megapack's lizzie directory, whose files work unless called by the Override command. C:\baduk\lizzie\katago.exe gtp -model C:\baduk\lizzie\KataGo40b.gz Processes: KaTrain: ERROR line 1 column 1 (char 0). When trying to play: GPU load 0%. ATTEMPT 4 C:\baduk\lizzie\katago.exe gtp -model C:\baduk\lizzie\KataGo40b.gz -config C:\baduk\lizzie\analysis_config.cfg Click on Update Settings: "KaTrain v.1.12.3 (no reply)" with the process KaTrain <0.01 CPU load Restart KaTrain: ERROR KataGo Engine Failed: exception: Could not find key 'logAllGTPCommunication' in config file C:\baduk\lizzie\analysis_config.cfg KATAGO-INTERNAL-ERROR Press ESC ATTEMPT 5 C:\baduk\lizzie\katago.exe -model C:\baduk\lizzie\KataGo40b.gz -config C:\baduk\lizzie\analysis_config.cfg Click on Update Settings, Restart KaTrain, ERROR line 1 column 1 (char 0). Trying to play: The ERROR vanishes. Analyzing move... appears. GPU load 0%. Katago.exe is the only process. ATTEMPT 6 If you wonder why I try (partial) Linux slashes from now on: KaTrain's settings write Path to KataGo model file = C:/baduk/lizzie/KataGo40b.gz C:\baduk\lizzie\katago.exe -model C:/baduk/lizzie/KataGo40b.gz -config C:\baduk\lizzie\analysis_config.cfg Click on Update Settings, Start new game, ERROR vanishes, trying to play: Analyzing move... appears. GPU load 0%. Katago.exe is the only process. ATTEMPT 7 C:\baduk\lizzie\katago.exe -model C:/baduk/lizzie/KataGo40b.gz -config C:/baduk/lizzie/analysis_config.cfg Click on Update Settings, ERROR line 1 column 1 (char 0), Start new game, ERROR vanishes, Analyzing move... appears. GPU load 0%. Katago.exe is the only process. ATTEMPT 8 C:/baduk/lizzie/katago.exe -model C:/baduk/lizzie/KataGo40b.gz -config C:/baduk/lizzie/analysis_config.cfg Click on Update Settings, Start new game, ERROR vanishes, trying to play: Analyzing move... appears. GPU load 0%. Katago.exe is the only process. |
Author: | RobertJasiek [ Fri Jun 09, 2023 3:47 pm ] |
Post subject: | Re: KaTrain Questions |
KaTrain I have made two more command line tests in KaTrain and both have failed. KaTrain must be buggy! Attempt 9 "C:\katago\katago.exe" gtp -model "C:\katago\b18.bin.gz" -config "C:\katago\gtp_custom.cfg" Attempt 10 "C:\baduk\test\katago.exe gtp" -model "C:\baduk\test\b18.bin.gz" -config "C:\baduk\test\gtp_custom.cfg" Lizzie Next, I have tried Lizzie and got it to work within one minute with the following command line in the Lizzie Engine settings: C:\katago\katago.exe gtp -model C:\katago\b18.bin.gz -config C:\katago\gtp_custom.cfg Playing works. GPU load 96%. Processes: |
Author: | thirdfogie [ Fri Jun 09, 2023 7:00 pm ] |
Post subject: | Re: KaTrain Questions |
Robert, Thanks for your detailed posts on these topics. My small comment is that Lizzie may also be buggy, at least on my system. If you have time, please run the following test. 1. Load a game into Lizzie for analysis by KataGo. 2. Select a small number of visits, for example 50, by typing a50. 3. Let the analysis run to the end. On my system, the resulting evaluation graph displays a downward red line marking every move as a mistake by Black, but no upward red lines for White. I suspect this is a bug in Lizzie not KataGo, but I don't know how to prove it. As the number of visits increases, the discrepancy slowly disappears. It is still noticeable with 1000 visits but not at 7000 visits per move. I normally use 7000. |
Page 2 of 3 | All times are UTC - 8 hours [ DST ] |
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group http://www.phpbb.com/ |