Built in C++, PowerInfer is an open-source LLM inference tool maintained by Tiiny-AI. The repository has collected 9.8k stars and 625 forks; the latest push was in May 2026. Related topics: large-language-models, llama and llm.
“High-speed Large Language Model Serving for Local Deployment”
— Tiiny-AI, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 9,837 |
| Forks | 625 |
| Language | C++ |
| License | MIT |
| Last updated | |
| Owner | Tiiny-AI |
| Repository | Tiiny-AI/PowerInfer |
Tags
large-language-modelsllamallmllm-inferencelocal-inference
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.