A strictly vetted directory of open-source artificial intelligence repositories, local LLM engines, multi-agent frameworks, and vector search tooling. Annotated with personal engineering takes from production builds.
Curated Open-Source AI Repositories
All Categories
MCP & Tooling
LLM SDKs
Inference & Serving
Agent Frameworks
RAG & Vector Search
Video & Media
Automation
Search & Grounding
LLM Tooling
INFERENCE & SERVING
vllm-project/vllm ↗
★ 36,000
A high-throughput and memory-efficient inference and serving engine for LLMs using PagedAttention.
Why It's Essential:
“The backbone of self-hosted open LLM deployments. 2-4x higher throughput than HuggingFace TGI.”
INFERENCE & SERVING
ollama/ollama ↗
★ 115,000
Get up and running with Llama 3, Mistral, and other large language models locally.
Why It's Essential:
“The Docker for local LLMs. Run 8B and 70B parameter open-weights models on Apple Silicon with 1 command.”