Local LLMs & Inference

gpt4all

by nomic-ai · C++

gpt4all is an open-source LLM inference tool published on GitHub by nomic-ai. It has 77k GitHub stars and 8.3k forks, and was last updated in May 2025. Topics include ai-chat and llm-inference.

“GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.”

— nomic-ai, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars77,348
Forks8,261
LanguageC++
LicenseMIT
Last updated
Ownernomic-ai
Websitenomic.ai/gpt4all
Repositorynomic-ai/gpt4all

Tags

ai-chatllm-inference

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for…

Local LLMs & Inference44k stars

gitleaks

Find secrets with Gitleaks 🔑

Local LLMs & Inference30k stars

llm-action

本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

Local LLMs & Inference25k stars

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Local LLMs & Inference14k stars

OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Local LLMs & Inference13k stars

openvino

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Local LLMs & Inference11k stars