A strictly vetted directory of open-source artificial intelligence repositories, local LLM engines, multi-agent frameworks, and vector search tooling. Annotated with personal engineering takes from production builds.
Curated Open-Source AI Repositories
BerriAI/litellm ↗
Call 100+ LLMs using the OpenAI Input/Output Format with proxy routing, fallbacks, and cost tracking.
“Unified interface for OpenAI, Anthropic, Gemini, Groq, and Bedrock with automatic fallback switching when an API is down.”
diegosouzapw/OmniRoute ↗
OmniRoute — universal LLM router with fallback, cost tracking and 18K stars gained in Aug, 48.7K total.
“I tested OmniRoute as a LiteLLM alternative from Junagadh — routing DeepSeek to Gemini with 3-line config held 85% savings. When NOT to use: for Pydantic-heavy tool validation keep LiteLLM.”
public-apis/public-apis ↗
Public APIs — 15K stars gained in Aug, 460.5K total, the definitive list for tool grounding.
“My tool grounding bible — I map every new MCP tool to this list before writing a Pydantic schema. When NOT: for curated MCP servers use Glama ranking instead.”
microsoft/AI-For-Beginners ↗
Microsoft AI For Beginners — 12.2K stars gained in Aug, 65K total, curriculum that onboards Gujarat SMEs to agents.
“My onboarding curriculum for Surat textile founders — 12 Jupyter notebooks that map to our MCP + Pydantic pipeline. When NOT: for prod harness use MAF instead.”
github/copilot-sdk ↗
GitHub Copilot SDK to embed Copilot agent workflows into apps across TypeScript, Python, Go, .NET and Java.
“Instead of copying agent prompts, you embed Copilot’s own agentic workflow SDK — April public preview kept it trending Aug 1 at #6 because it turns any app into a Copilot-native agent host. Rating: 4.6/5. When NOT to use: Avoid if you require 100% open-weight inference — the SDK is Copilot-coupled and assumes GitHub-hosted model routing.”
AlexsJones/llmfit ↗
Hundreds of models & providers. One command to find what actually runs on your hardware — RAM/CPU/GPU aware fit with quant scoring.
“My Junagadh edge boxes run Pi5/4070 mixes — llmfit replaces guesswork with real fit + tok/s estimates across Q2_K→Q8_0. v1.1.12 now PRs measured tok/s back, which is why it held 34.5k stars and Repo Radar #2 Aug 28. Rating: 4.8/5. When NOT to use: Not for pure cloud API routing — llmfit shines for local/self-hosted sizing, not for OpenAI-only bill tracking.”
vllm-project/semantic-router ↗
Semantic routing for LLMs — neural classifiers over heuristics, routes to OpenAI/Anthropic/Azure/Bedrock/Gemini/Vertex.
“My hybrid router keeps 80% on SLM Pi5; semantic-router is the production-grade version — neural domain classifiers, multi-backend. 5,376 stars Go, Apache-2.0, and the missing layer under Maka/llmfit is why it trended Aug 28. Rating: 4.5/5. When NOT to use: Skip if you route by static rules — gains appear when prompt intent actually needs classifier, not simple keyword.”
jingyaogong/minimind ↗
Tiny LLM series from scratch — 0.1B omni model (115M, Apache-2.0) to 3B, trains on consumer GPU in hours.
“I build offline-first agents for Junagadh where 4G drops — minimind lets me pre-train a 115M model on a ₹6K VPS and run 62 tok/s on Pi 5. Its from-scratch recipe demystifies tokenization and MoE better than any course.”
mksglu/context-mode ↗
Context window optimization for AI coding agents — sandboxes tool output (98% reduction), persists session memory, enforces routing across 17 platforms via MCP + hooks.
“I run P95 42ms HNSW + 90-day OTel ledger from Junagadh where every token counts — context-mode cut my Claude Code context by 98% sandboxed and stopped re-reads after /compact. Its MCP hook routing across 17 platforms is the missing persistence layer I built manually for Gujarat SMEs on Pi 5 62 tok/s.”
marin-community/marin ↗
Open framework for foundation model R&D — trains & evaluates LLMs at scale.
“For IndiaAI mission labs & Gujarat universities — train small BharatGen-style models on ₹65/hr GPUs without closed APIs.”
BraveOPotato/FckSignups ↗
A list of open-source, in-browser, no-signup tools — 3,671 stars, 497 today. Trending Sep 6, complements local-first stack.
“I champion local-first from Junagadh (offline 70B, Pi 5) — FckSignups is the directory that keeps my clients off SaaS signup traps. I pull its in-browser tools into my stack docs when I spec no-signup fallbacks for Gujarat SMEs on tight data.”