Local LLMs & Inference

lws

by kubernetes-sigs · Go

lws is an open-source LLM inference tool written in Go, released under the Apache-2.0 license. It has 882 GitHub stars and 197 forks, and was last updated in October 2026. Related topics: llm-inference and sig-apps.

“LeaderWorkerSet: An API for deploying a group of pods as a unit of replication”

— kubernetes-sigs, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars882
Forks197
LanguageGo
LicenseApache-2.0
Last updated
Ownerkubernetes-sigs
Websitelws.sigs.k8s.io
Repositorykubernetes-sigs/lws

Tags

llm-inferencesig-apps

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Local LLMs & Inference77k stars

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for…

Local LLMs & Inference44k stars

gitleaks

Find secrets with Gitleaks 🔑

Local LLMs & Inference30k stars

llm-action

本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

Local LLMs & Inference25k stars

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Local LLMs & Inference14k stars

OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Local LLMs & Inference13k stars