Local LLMs & Inference

lemonade

by lemonade-sdk · C++

Built in C++, lemonade is an open-source LLM inference tool maintained by lemonade-sdk. The repository has collected 5.9k stars and 532 forks; the latest push was in October 2026. Docs and downloads are linked from lemonade-server.ai.

“Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk”

— lemonade-sdk, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars5,929
Forks532
LanguageC++
LicenseApache-2.0
Last updated
Ownerlemonade-sdk
Websitelemonade-server.ai
Repositorylemonade-sdk/lemonade

Tags

aiamdgenaigpullamallmllm-inferencelocal-server

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU…

Local LLMs & Inference5.8k stars

Awesome-LLM-Inference

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4…

Local LLMs & Inference5.5k stars

superduper

Superduper: End-to-end framework for building custom AI applications and agents.

Local LLMs & Inference5.3k stars

eko

Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai

Local LLMs & Inference5k stars

RuVector

RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB…

Local LLMs & Inference4.6k stars

optillm

Optimizing inference proxy for LLMs

Local LLMs & Inference4.3k stars