Awesome-LLM-Inference is an open-source LLM inference tool written in Python, released under the GPL-3.0 license. It has 5.5k GitHub stars and 438 forks, and was last updated in August 2026. Topics include awesome-llm, deepseek and deepseek-r1.
“📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉”
— xlite-dev, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 5,531 |
| Forks | 438 |
| Language | Python |
| License | GPL-3.0 |
| Last updated | |
| Owner | xlite-dev |
| Repository | xlite-dev/Awesome-LLM-Inference |
Tags
awesome-llmdeepseekdeepseek-r1deepseek-v3flash-attentionflash-attention-3flash-mlallm-inference
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.