LLM Frameworks & MLOps

Soup

by MakazhanAlpamys · Python

Soup is an open-source LLMOps tool written in Python, released under the Apache-2.0 license. The repository has collected 9.3k stars and 1.5k forks; the latest push was in October 2026. Related topics: cli, consumer-gpu and dpo.

“Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.”

— MakazhanAlpamys, project description on GitHub

Details

CategoryLLM Frameworks & MLOps
GitHub stars9,346
Forks1,531
LanguagePython
LicenseApache-2.0
Last updated
OwnerMakazhanAlpamys
Websitetrysoup.dev
RepositoryMakazhanAlpamys/Soup

Tags

cliconsumer-gpudpofine-tuningggufhuggingfacellmllmops

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All LLM Frameworks & MLOps

rig

⚙️🦀 Build modular and scalable LLM Applications in Rust

LLM Frameworks & MLOps8.9k stars

evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered…

LLM Frameworks & MLOps8k stars

openllmetry

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

LLM Frameworks & MLOps7.5k stars

clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management…

LLM Frameworks & MLOps6.9k stars

agent-starter-pack

Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD…

LLM Frameworks & MLOps6.6k stars

helicone

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

LLM Frameworks & MLOps6.2k stars