LLM Frameworks & MLOps

serve

by jina-ai · Python

serve is an open-source LLMOps tool from jina-ai, licensed under Apache-2.0. It has 22k GitHub stars and 2.2k forks, and was last updated in March 2025. Topics include cloud-native, cncf and deep-learning.

“☁️ Build multimodal AI applications with cloud-native stack”

— jina-ai, project description on GitHub

Details

CategoryLLM Frameworks & MLOps
GitHub stars21,854
Forks2,239
LanguagePython
LicenseApache-2.0
Last updated
Ownerjina-ai
Websitejina.ai/serve
Repositoryjina-ai/serve

Tags

cloud-nativecncfdeep-learningdockerfastapiframeworkgenerative-aigrpc

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All LLM Frameworks & MLOps

SuperAGI

SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run…

LLM Frameworks & MLOps18k stars

RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent…

LLM Frameworks & MLOps16k stars

ragas

Supercharge Your LLM Application Evaluations 🚀

LLM Frameworks & MLOps16k stars

gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast…

LLM Frameworks & MLOps13k stars

phoenix

AI Observability & Evaluation

LLM Frameworks & MLOps12k stars

metaflow

Build, Manage and Deploy AI/ML Systems

LLM Frameworks & MLOps10k stars