Great app – a few small ideas (GPU/NPU)

[felixnissen]

Summary
GPU/NPU for text models + basic model clarity
Problem
Text models seem CPU-only (quite slow). Also unclear which models support tools.
Suggestion
GPU/NPU for text models
Show tool support per model
Simple filters (tools / vision / fast)
Platform
Android
Extra
Really promising app

[felixnissen]

Thanks! I may be missing a setting, but from what I can see on my device, text models still show CPU in generation details and remain very slow, while image appears to use GPU/NPU.

[felixnissen]

here’s my setup:
Android (OnePlus 12R, Snapdragon 8 Gen 2)
Running locally in the app
Using GGUF models (tested Qwen2.5 3B / 7B)
What I’m seeing:
Text models show CPU in generation details and are very slow
Image models seem to use NPU/GPU
Image generation sometimes fails with:
“Server did not return a complete event”
Tool support varies (some models show tools, others N/A)