Local LLMs & Inference

splash

by incoai · C++

splash is an open-source LLM inference tool written in C++, released under the Apache-2.0 license. It has 1.5k GitHub stars and 147 forks, and was last updated in October 2026. Docs and downloads are linked from inco.ai.

“A local inference engine for Apple silicon, built around the model.”

— incoai, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,540
Forks147
LanguageC++
LicenseApache-2.0
Last updated
Ownerincoai
Websiteinco.ai/blog/splash
Repositoryincoai/splash

Tags

apple-siliconcoding-agentsllm-inferencemacosmetalspeculative-decoding

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

zero-to-sglang

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch…

Local LLMs & Inference1.5k stars

scaling-book

Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs

Local LLMs & Inference1.5k stars

awesome-ai-web-search

List of software that allows searching the web with the assistance of AI…

Local LLMs & Inference1.5k stars

BrowserAI

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

Local LLMs & Inference1.4k stars

awesome-hacking-lists

A curated collection of top-tier penetration testing tools and productivity utilities across multiple…

Local LLMs & Inference1.4k stars

TensorFold

LLM Inference Engine for Metal and CUDA.

Local LLMs & Inference1.4k stars