optillm is an open-source LLM inference tool published on GitHub by algorithmicsuperintelligence. The repository has collected 4.3k stars and 410 forks; the latest push was in October 2026. Topics include agent, agentic-ai and agentic-framework.
“Optimizing inference proxy for LLMs”
— algorithmicsuperintelligence, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 4,319 |
| Forks | 410 |
| Language | Python |
| License | Apache-2.0 |
| Last updated | |
| Owner | algorithmicsuperintelligence |
| Repository | algorithmicsuperintelligence/optillm |
Tags
agentagentic-aiagentic-frameworkagentic-workflowagentsapi-gatewaychain-of-thoughtgenai
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.