Local LLMs & Inference

EAGLE

by SafeAILab · Python

Built in Python, EAGLE is an open-source LLM inference tool maintained by SafeAILab. The repository has collected 2.6k stars and 297 forks; the latest push was in February 2026. Docs and downloads are linked from arxiv.org.

“Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).”

— SafeAILab, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars2,555
Forks297
LanguagePython
Last updated
OwnerSafeAILab
Websitearxiv.org/pdf/2503.01840
RepositorySafeAILab/EAGLE

Tags

large-language-modelsllm-inferencespeculative-decoding

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

nanocoder

An open coding agent for your terminal, built by a community collective rather than a company. Bring your…

Local LLMs & Inference2.5k stars

neuron-ai

The Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect…

Local LLMs & Inference2.1k stars

aici

AICI: Prompts as (Wasm) Programs

Local LLMs & Inference2.1k stars

HyperQwen

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…

Local LLMs & Inference2.1k stars

llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper`…

Local LLMs & Inference1.9k stars

InferenceX

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

Local LLMs & Inference1.9k stars