gpustack is an open-source LLM inference tool written in Python, released under the Apache-2.0 license. With 5.8k stars on GitHub, it was last updated in October 2026. Topics include ascend, cuda and deepseek.
“A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.”
— gpustack, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 5,844 |
| Forks | 687 |
| Language | Python |
| License | Apache-2.0 |
| Last updated | |
| Owner | gpustack |
| Website | gpustack.ai |
| Repository | gpustack/gpustack |
Tags
ascendcudadeepseekdistributed-inferencegenaihigh-performance-inferenceinferencellama
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.