cactus is an open-source LLM inference tool published on GitHub by cactus-compute. The repository has collected 6.1k stars and 518 forks; the latest push was in September 2026. Topics include ai, android and arm.
“Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.”
— cactus-compute, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 6,128 |
| Forks | 518 |
| Language | C++ |
| Last updated | |
| Owner | cactus-compute |
| Website | cactuscompute.com |
| Repository | cactus-compute/cactus |
Tags
aiandroidarmedgeedge-aiframeworkiosllamacpp
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.