kserve is an open-source LLM inference tool from kserve, licensed under Apache-2.0. With 6.1k stars on GitHub, it was last updated in October 2026. Topics include artificial-intelligence, cncf and genai.
“Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes”
— kserve, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 6,130 |
| Forks | 1,741 |
| Language | Go |
| License | Apache-2.0 |
| Last updated | |
| Owner | kserve |
| Website | kserve.github.io/website |
| Repository | kserve/kserve |
Tags
artificial-intelligencecncfgenaihacktoberfestistiok8sknativekserve
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.