Page 33 of 37

Re: New android app "BadukAI"

Posted: Sat Dec 03, 2022 4:03 pm
by akigo
@lovego
There is no katago release yet that supports the new 18b architecture and the code is still in branches, so I can't release anything yet.

But I have made a test version that supports the new 18b network, available at https://github.com/aki65/aki65.github.i ... ag/v1.18.1. I have added two "optimized" versions of the UEC-network (unfortunately it turned out that HW support on android for the structure and operations of the new network architecture is far worse than for the old networks, so they are much slower):

1) b18c384nbt-uec-20221121b-quant
This is an 8-bit quantized network. On Snapdragon 888 and 8+ gen 1, it behaves as follows:
If you choose UseSpecificNpuAccelerator = 5 in settings (and numSearchThreads = 3 and tick "parallelEvaluation"), it will run on CPU and be about 50% faster than the original network. If you choose UseSpecificNpuAccelerator = 1, it should run on NPU, but:
On SD 888 it stays on CPU, so no speed change
ON SD 8+ gen 1 it runs on NPU (pretty fast), but produces wrong results.
It would be interesting how it behaves on Dimensity 9000, so it would be very nice, if your friend could check that.

2) b18c384nbt-uec-20221121b
This is a 32-bit network. On Snapdragon 888 and 8+ gen 1, it runs best if you choose UseSpecificNpuAccelerator = 3 in settings (and numSearchThreads = 3 and tick "parallelEvaluation"). Then it's about 3.5 times faster than the original network. Here also it would be interesting if your friend could check its behaviour on Dimensity 9000.

Re: New android app "BadukAI"

Posted: Sat Dec 03, 2022 10:32 pm
by lovego
Thank you for your new version. I tested it on my mobile phone. It is really slow and weaker than the previous 20b weight :tmbup:

Re: New android app "BadukAI"

Posted: Fri Dec 23, 2022 10:03 pm
by lovego
Hello, I found a new problem. I tested a new mobile phone using Qualcomm's latest CPU (8Gen2) and found that the speed was very slow, about 15n/s. What may be the problem? I have switched and tried all the npu options

Re: New android app "BadukAI"

Posted: Sat Dec 24, 2022 7:31 am
by akigo
BadukAI uses the android NNAPI interface for neural networks. Here benchmark scores for SD8gen2 are much lower than for SD8(+)gen1. Compare

SD8gen2: https://browser.geekbench.com/search?k= ... e&q=kalama

SD8(+)gen1: https://browser.geekbench.com/search?k= ... nce&q=taro

This is very strange since the new chipset should be more powerful. I can only speculate on the reason: Maybe the NNAPI driver for the new chipset isn't working correctly yet (after all the new phones were rushed out only a few weeks after presentation of SD8gen2).

Re: New android app "BadukAI"

Posted: Wed Jan 11, 2023 6:21 pm
by lovego
KataGo 1.12.2 has been released! Will badukAI update it?

Re: New android app "BadukAI"

Posted: Sun Jan 15, 2023 12:40 pm
by akigo
I will certainly update at some point, but not right now, since I'm still investigating if the new architecture networks can somehow be used effectively on android. Since the result may affect the code of my android backend, I will only update when that task is finished (otherwise I might have to update twice).

Re: New android app "BadukAI"

Posted: Wed Jan 18, 2023 2:08 pm
by akigo
I made a new test release at https://github.com/aki65/aki65.github.i ... ag/v1.18.2 which provides an improved version of the quantized 18b network. If you are interested, check it out.

Re: New android app "BadukAI"

Posted: Wed Jan 18, 2023 7:41 pm
by And
will baduk_ai__armeabi-v7a come out?
on my devices, 18b will be faster and stronger anyway

Re: New android app "BadukAI"

Posted: Thu Jan 19, 2023 2:58 am
by Amigo
And wrote:will baduk_ai__armeabi-v7a come out?
on my devices, 18b will be faster and stronger anyway
I'm also waiting for version armeabi-v7a

Re: New android app "BadukAI"

Posted: Fri Jan 20, 2023 3:05 pm
by akigo
The merge with KataGo 1.12.2 is still in progress, but I made a preliminary version for both arm64-v8a and armeabi-v7a here: https://github.com/aki65/aki65.github.i ... ag/v1.18.3

Re: New android app "BadukAI"

Posted: Sun Feb 19, 2023 9:13 am
by akigo
@lovego
If you still have access to Snapdragon 8 Gen 2 device, you could try the latest test release: https://github.com/aki65/aki65.github.i ... ag/v1.18.4

Re: New android app "BadukAI"

Posted: Mon Feb 20, 2023 2:29 am
by lovego
It's crazy, 400+n/s, amazing speed! Now it's faster than my computer :clap: :clap: :clap:

Re: New android app "BadukAI"

Posted: Mon Feb 20, 2023 2:34 am
by lovego
After the Kata engine is updated to v1.12.4, I think it's time to release an official version. This version is so great! :tmbup:

Re: New android app "BadukAI"

Posted: Mon Feb 20, 2023 7:40 am
by lovego
I tested on my huawei phone, this engine crashes!

Re: New android app "BadukAI"

Posted: Mon Feb 20, 2023 1:18 pm
by akigo
@lovego
Which chipset does the huawei phone have ?
Did you load a .dlc file or a .tflite file ?