aici is an open-source LLM inference tool from microsoft, licensed under MIT. It has 2.1k GitHub stars and 86 forks, and was last updated in January 2025. Topics include ai, inference and language-model.
“AICI: Prompts as (Wasm) Programs”
— microsoft, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 2,076 |
| Forks | 86 |
| Language | Rust |
| License | MIT |
| Last updated | |
| Owner | microsoft |
| Repository | microsoft/aici |
| Also listed in | LLM Frameworks & MLOps |
Tags
aiinferencelanguage-modelllmllm-frameworkllm-inferencellm-servingllmops
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.