Local LLMs & Inference

ai-engineering-interview-questions

by amitshekhariitbhu · Markdown

ai-engineering-interview-questions is an open-source LLM inference tool written in Markdown, released under the Apache-2.0 license. It has 3.5k GitHub stars and 637 forks, and was last updated in October 2026. Related topics: agents, ai and ai-agents.

“Your Cheat Sheet for AI Engineering Interview – Questions and Answers.”

— amitshekhariitbhu, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars3,472
Forks637
LanguageMarkdown
LicenseApache-2.0
Last updated
Owneramitshekhariitbhu
Websiteoutcomeschool.com/program/ai-and-machine-learning
Repositoryamitshekhariitbhu/ai-engineering-interview-questions

Tags

agentsaiai-agentsai-engineeringfine-tuninginterviewinterview-preparationinterview-questions

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More…

Local LLMs & Inference3.1k stars

spiceai

Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query…

Local LLMs & Inference3.1k stars

Medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Local LLMs & Inference2.8k stars

MTPLX

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in…

Local LLMs & Inference2.6k stars

EAGLE

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).

Local LLMs & Inference2.6k stars

nanocoder

An open coding agent for your terminal, built by a community collective rather than a company. Bring your…

Local LLMs & Inference2.5k stars