Local LLMs & Inference

jev

by feder-cr · C++

jev is an open-source LLM inference tool published on GitHub by feder-cr. With 1.4k stars on GitHub, it was last updated in October 2026. Topics include ai, classification and cpu-inference.

“jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.”

— feder-cr, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,357
Forks173
LanguageC++
LicenseMIT
Last updated
Ownerfeder-cr
Websitehuggingface.co/feder-cr/jev
Repositoryfeder-cr/jev

Tags

aiclassificationcpu-inferencedecision-modeledge-aiggufjevjev-alternative

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

LeanCopilot

LLMs as Copilots for Theorem Proving in Lean

Local LLMs & Inference1.3k stars

prompt-poet

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

Local LLMs & Inference1.2k stars

tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Local LLMs & Inference1.2k stars

OpenAlpha_Evolve

OpenAlpha_Evolve is an open-source Python framework inspired by the groundbreaking research on autonomous…

Local LLMs & Inference1.1k stars

backburner

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

Local LLMs & Inference1k stars

project-maya

Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or…

Local LLMs & Inference1k stars