Local LLMs & Inference

AI-Engineer-Headquarters

by hemansnation · Jupyter Notebook

AI-Engineer-Headquarters is an open-source LLM inference tool published on GitHub by hemansnation. With 3.8k stars on GitHub, it was last updated in October 2026. Docs and downloads are linked from masterdexter.io.

“A collection of scientific methods, processes, algorithms, and systems to build stories & models.”

— hemansnation, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars3,769
Forks704
LanguageJupyter Notebook
Last updated
Ownerhemansnation
Websitewww.masterdexter.io/ai-engineer-hq
Repositoryhemansnation/AI-Engineer-Headquarters

Tags

aiai-agentsaiengineeringdata-structures-and-algorithmsdeep-learninglangchainlanggraphllm

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More…

Local LLMs & Inference3.1k stars

spiceai

Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query…

Local LLMs & Inference3.1k stars

Medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Local LLMs & Inference2.8k stars

MTPLX

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in…

Local LLMs & Inference2.6k stars

EAGLE

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).

Local LLMs & Inference2.6k stars