Local LLMs & Inference

zero-to-sglang

by datawhalechina · Python

zero-to-sglang is an open-source LLM inference tool published on GitHub by datawhalechina. It has 1.5k GitHub stars and 116 forks, and was last updated in October 2026. Docs and downloads are linked from datawhalechina.github.io.

“Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.”

— datawhalechina, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,509
Forks116
LanguagePython
Last updated
Ownerdatawhalechina
Websitedatawhalechina.github.io/zero-to-sglang
Repositorydatawhalechina/zero-to-sglang

Tags

cudadatawhaleinference-engineinfrakv-cachellmllm-inferencesglang

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

scaling-book

Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs

Local LLMs & Inference1.5k stars

awesome-ai-web-search

List of software that allows searching the web with the assistance of AI…

Local LLMs & Inference1.5k stars

BrowserAI

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

Local LLMs & Inference1.4k stars

awesome-hacking-lists

A curated collection of top-tier penetration testing tools and productivity utilities across multiple…

Local LLMs & Inference1.4k stars

TensorFold

LLM Inference Engine for Metal and CUDA.

Local LLMs & Inference1.4k stars

jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with…

Local LLMs & Inference1.4k stars