Local LLMs & Inference

project-maya

by mw00 · C++

Built in C++, project-maya is an open-source LLM inference tool maintained by mw00. It has 1k GitHub stars and 136 forks, and was last updated in October 2026. Topics include cuda, glm and glm-5.

“Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.”

— mw00, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,032
Forks136
LanguageC++
LicenseMIT
Last updated
Ownermw00
Websitehuggingface.co/peasantsmith/GLM-5.3-Flash-Maya-GGUF
Repositorymw00/project-maya

Tags

cudaglmglm-5llmllm-inferencelocal-llmmixture-of-expertsmoe

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

time-to-first-token

A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization…

Local LLMs & Inference994 stars

AI-Compass

“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI…

Local LLMs & Inference983 stars

awesome-hosting

List of awesome hosting sorted by minimal plan price

Local LLMs & Inference944 stars

chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

Local LLMs & Inference933 stars

ZhiLight

A highly optimized LLM inference acceleration engine for Llama and its variants.

Local LLMs & Inference907 stars

llm_note

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Local LLMs & Inference893 stars