It is currently Fri Jan 27, 2023 8:34 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 490 posts ]  Go to page Previous  1 ... 21, 22, 23, 24, 25
Author Message
Offline
 Post subject: Re: New android app "BadukAI"
Post #481 Posted: Sat Dec 03, 2022 4:03 pm 
Lives with ko

Posts: 160
Liked others: 13
Was liked: 146
@lovego
There is no katago release yet that supports the new 18b architecture and the code is still in branches, so I can't release anything yet.

But I have made a test version that supports the new 18b network, available at https://github.com/aki65/aki65.github.io/releases/tag/v1.18.1. I have added two "optimized" versions of the UEC-network (unfortunately it turned out that HW support on android for the structure and operations of the new network architecture is far worse than for the old networks, so they are much slower):

1) b18c384nbt-uec-20221121b-quant
This is an 8-bit quantized network. On Snapdragon 888 and 8+ gen 1, it behaves as follows:
If you choose UseSpecificNpuAccelerator = 5 in settings (and numSearchThreads = 3 and tick "parallelEvaluation"), it will run on CPU and be about 50% faster than the original network. If you choose UseSpecificNpuAccelerator = 1, it should run on NPU, but:
On SD 888 it stays on CPU, so no speed change
ON SD 8+ gen 1 it runs on NPU (pretty fast), but produces wrong results.
It would be interesting how it behaves on Dimensity 9000, so it would be very nice, if your friend could check that.

2) b18c384nbt-uec-20221121b
This is a 32-bit network. On Snapdragon 888 and 8+ gen 1, it runs best if you choose UseSpecificNpuAccelerator = 3 in settings (and numSearchThreads = 3 and tick "parallelEvaluation"). Then it's about 3.5 times faster than the original network. Here also it would be interesting if your friend could check its behaviour on Dimensity 9000.


This post by akigo was liked by: Vargo
Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #482 Posted: Sat Dec 03, 2022 10:32 pm 
Dies in gote

Posts: 40
Liked others: 0
Was liked: 0
Rank: KGS 1 dan
Thank you for your new version. I tested it on my mobile phone. It is really slow and weaker than the previous 20b weight :tmbup:

Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #483 Posted: Fri Dec 23, 2022 10:03 pm 
Dies in gote

Posts: 40
Liked others: 0
Was liked: 0
Rank: KGS 1 dan
Hello, I found a new problem. I tested a new mobile phone using Qualcomm's latest CPU (8Gen2) and found that the speed was very slow, about 15n/s. What may be the problem? I have switched and tried all the npu options

Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #484 Posted: Sat Dec 24, 2022 7:31 am 
Lives with ko

Posts: 160
Liked others: 13
Was liked: 146
BadukAI uses the android NNAPI interface for neural networks. Here benchmark scores for SD8gen2 are much lower than for SD8(+)gen1. Compare

SD8gen2: https://browser.geekbench.com/search?k=ml_inference&q=kalama

SD8(+)gen1: https://browser.geekbench.com/search?k=ml_inference&q=taro

This is very strange since the new chipset should be more powerful. I can only speculate on the reason: Maybe the NNAPI driver for the new chipset isn't working correctly yet (after all the new phones were rushed out only a few weeks after presentation of SD8gen2).

Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #485 Posted: Wed Jan 11, 2023 6:21 pm 
Dies in gote

Posts: 40
Liked others: 0
Was liked: 0
Rank: KGS 1 dan
KataGo 1.12.2 has been released! Will badukAI update it?

Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #486 Posted: Sun Jan 15, 2023 12:40 pm 
Lives with ko

Posts: 160
Liked others: 13
Was liked: 146
I will certainly update at some point, but not right now, since I'm still investigating if the new architecture networks can somehow be used effectively on android. Since the result may affect the code of my android backend, I will only update when that task is finished (otherwise I might have to update twice).

Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #487 Posted: Wed Jan 18, 2023 2:08 pm 
Lives with ko

Posts: 160
Liked others: 13
Was liked: 146
I made a new test release at https://github.com/aki65/aki65.github.io/releases/tag/v1.18.2 which provides an improved version of the quantized 18b network. If you are interested, check it out.

Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #488 Posted: Wed Jan 18, 2023 7:41 pm 
Lives in sente
User avatar

Posts: 1107
Liked others: 184
Was liked: 171
will baduk_ai__armeabi-v7a come out?
on my devices, 18b will be faster and stronger anyway


This post by And was liked by: Amigo
Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #489 Posted: Thu Jan 19, 2023 2:58 am 
Dies in gote

Posts: 47
Liked others: 34
Was liked: 9
And wrote:
will baduk_ai__armeabi-v7a come out?
on my devices, 18b will be faster and stronger anyway

I'm also waiting for version armeabi-v7a

Top
 Profile  
 
Offline
 Post subject: Re: New android app "BadukAI"
Post #490 Posted: Fri Jan 20, 2023 3:05 pm 
Lives with ko

Posts: 160
Liked others: 13
Was liked: 146
The merge with KataGo 1.12.2 is still in progress, but I made a preliminary version for both arm64-v8a and armeabi-v7a here: https://github.com/aki65/aki65.github.io/releases/tag/v1.18.3


This post by akigo was liked by: And
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 490 posts ]  Go to page Previous  1 ... 21, 22, 23, 24, 25

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group