Local LLMs & Inference

InferenceX

by SemiAnalysisAI · Python

InferenceX is an open-source LLM inference tool published on GitHub by SemiAnalysisAI. With 1.9k stars on GitHub, it was last updated in October 2026. Topics include agentic, agentic-ai and amd.

“Open Source AI Accelerator Research Platform Standard / 开源推理研究平台”

— SemiAnalysisAI, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,875
Forks333
LanguagePython
LicenseApache-2.0
Last updated
OwnerSemiAnalysisAI
Websiteinferencex.com
RepositorySemiAnalysisAI/InferenceX

Tags

agenticagentic-aiamdbenchmarkingbenchmarkscudadeepseekgpu

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

aigrantsindia

The non profit fostering AI in India through credits, grants, resources

Local LLMs & Inference1.8k stars

beta9

Ultrafast serverless GPU inference, sandboxes, and background jobs

Local LLMs & Inference1.8k stars

kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Local LLMs & Inference1.8k stars

Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

Local LLMs & Inference1.8k stars

react-native-executorch

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's…

Local LLMs & Inference1.8k stars