Local LLMs & Inference

superduper

by superduper-io · Python

superduper is an open-source LLM inference tool published on GitHub by superduper-io. It has 5.3k GitHub stars and 546 forks, and was last updated in September 2025. Docs and downloads are linked from superduper.io.

“Superduper: End-to-end framework for building custom AI applications and agents.”

— superduper-io, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars5,325
Forks546
LanguagePython
LicenseApache-2.0
Last updated
Ownersuperduper-io
Websitesuperduper.io
Repositorysuperduper-io/superduper
Also listed inLLM Frameworks & MLOps

Tags

aichatbotdatadatabasedistributed-mlinferencellm-inferencellm-serving

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

eko

Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai

Local LLMs & Inference5k stars

RuVector

RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB…

Local LLMs & Inference4.6k stars

optillm

Optimizing inference proxy for LLMs

Local LLMs & Inference4.3k stars

GenerativeAIExamples

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

Local LLMs & Inference4.2k stars

Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple…

Local LLMs & Inference4k stars

AI-Engineer-Headquarters

A collection of scientific methods, processes, algorithms, and systems to build stories & models.

Local LLMs & Inference3.8k stars