A strictly vetted directory of open-source artificial intelligence repositories, local LLM engines, multi-agent frameworks, and vector search tooling. Annotated with personal engineering takes from production builds.
Curated Open-Source AI Repositories
All Categories
MCP & Tooling
LLM SDKs
Inference & Serving
Agent Frameworks
RAG & Vector Search
Video & Media
Automation
Search & Grounding
LLM Tooling
Content
Workflow Orchestration
Data & Storage
Learning
AI Operations
Infrastructure
INFERENCE & SERVING
vllm-project/vllm ↗
★ 36,000
A high-throughput and memory-efficient inference and serving engine for LLMs using PagedAttention.
Why It's Essential:
“The backbone of self-hosted open LLM deployments. 2-4x higher throughput than HuggingFace TGI.”
INFERENCE & SERVING
ollama/ollama ↗
★ 115,000
Get up and running with Llama 3, Mistral, and other large language models locally.
Why It's Essential:
“The Docker for local LLMs. Run 8B and 70B parameter open-weights models on Apple Silicon with 1 command.”
INFERENCE & SERVING
open-webui/open-webui ↗
★ 127,000
Self-hosted ChatGPT-style UI for Ollama/OpenAI APIs — 127k stars, fully offline, 282M downloads.
Why It's Essential:
“Run Sarvam/BharatGen/Ollama locally in Gujarat VPC — no US data routing, perfect for DPDP + ₹0 token cost.”