Built in Jupyter Notebook, Medusa is an open-source LLM inference tool maintained by FasterDecoding. With 2.8k stars on GitHub, it was last updated in June 2024. Topics include llm and llm-inference.
“Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads”
— FasterDecoding, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 2,775 |
| Forks | 206 |
| Language | Jupyter Notebook |
| License | Apache-2.0 |
| Last updated | |
| Owner | FasterDecoding |
| Website | sites.google.com/view/medusa-llm |
| Repository | FasterDecoding/Medusa |
Tags
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.