Local LLMs & Inference

aigrantsindia

by aigrantsindia

aigrantsindia is an open-source LLM inference tool published on GitHub by aigrantsindia. With 1.8k stars on GitHub, it was last updated in June 2025. Related topics: ai, grants and hackathons.

“The non profit fostering AI in India through credits, grants, resources”

— aigrantsindia, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,835
Forks6
Last updated
Owneraigrantsindia
Websitex.com/@aigrantsindia
Repositoryaigrantsindia/aigrantsindia

Tags

aigrantshackathonsindiallm-inferencellms

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

beta9

Ultrafast serverless GPU inference, sandboxes, and background jobs

Local LLMs & Inference1.8k stars

kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Local LLMs & Inference1.8k stars

Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

Local LLMs & Inference1.8k stars

react-native-executorch

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's…

Local LLMs & Inference1.8k stars

xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.…

Local LLMs & Inference1.6k stars