Infrastructure AI Repositories — Curated Open Source | Deepak Bagada
Vol. 01 — 2026

Curated Open-Source AI Repositories

A strictly vetted directory of open-source artificial intelligence repositories, local LLM engines, multi-agent frameworks, and vector search tooling. Annotated with personal engineering takes from production builds.

★ 18,100

Gods Eye View — geospatial God-view dashboard with satellite + vector search. JS, Sep 2026 #10 +4.6k (18.1k total).

Why It's Essential:

“I build map-pack + AI citation stacks for Gujarat local SEO — gods-eye-view showed me how to fuse satellite tiles with pgvector HNSW 42ms for hyperlocal context. Its JS dashboard is the geo layer I bolt onto my Junagadh → Gujarat → India 4-tier ranking.”

#geospatial #satellite #dashboard #javascript
★ 25,900

Obscura — Rust security obfuscation & deobfuscation toolkit. Sep 2026 #13 +3.7k (25.9k total).

Why It's Essential:

“I audit MCP skills where 26% request broad permissions per SkillSpector — obscura gives my Junagadh ledger a Rust path to test obfuscation before OPA denies. Its deobfuscation flow is the pre-flight I run before any HITL-gated shell tool.”

#rust #security #obfuscation #reverse-engineering
INFRASTRUCTURE

omacom/omarchy ↗

★ 38,400

Omarchy — opinionated Arch + Hyprland setup with AI agent hooks. Shell, Sep 2026 #19 +3.0k (38.4k total).

Why It's Essential:

“I ship from Junagadh on a ₹6K VPS where dotfiles drift kills P95 — omarchy gave me a deterministic Hyprland + hooks setup I containerize for Pi 5. Its opinionated Arch is the dev env I snapshot before n8n + MCP deploys.”

#arch #hyprland #omarchy #shell
★ 75,986

WorldMonitor — real-time global intelligence dashboard. AI-powered news aggregation, geopolitical monitoring, infrastructure tracking in one situational awareness interface. TS, weekly #1 +12k Sep 18 2026 (76k stars).

Why It's Essential:

“I scan AI news nightly for my journal from Junagadh, and hand-rolled aggregators rot within weeks. WorldMonitor fusing news plus geopolitical plus infra signals into one dashboard is the situational layer I want above my SearXNG scanner. I would self-host it on the Rs 6K VPS and point my research agents at its feed before any manual browsing.”

#intel-dashboard #news-aggregation #monitoring #typescript
INFRASTRUCTURE

ruvnet/RuView ↗

★ 87,316

RuView — turns commodity WiFi signals into real-time spatial intelligence, vital-sign monitoring, presence detection. Zero video pixels. Rust, 87.3k stars, +5k week Sep 18 2026.

Why It's Essential:

“I work with Gujarat retail shops where cameras trigger DPDP anxiety but footfall data drives staffing. RuView doing presence plus vital signs from WiFi with no video is the privacy-shaped sensor I would actually get permission to install. I would pair it with my WhatsApp footfall alerts on the Rs 6K VPS and keep every byte inside the shop network.”

#wifi-sensing #spatial-intel #rust #privacy
★ 36,975

1Panel — modern open-source Linux server management panel and lightweight AI management platform. Go, 37k stars (verified via API Sep 19 2026).

Why It's Essential:

“I run client workloads on a Rs 6K VPS from Junagadh where every deploy is SSH plus memory. 1Panel giving that box a panel plus AI management without cloud rent is the ops layer my Gujarat SME fleet wants. I would trial it beside my current hardened Ubuntu image and keep whichever survives a monsoon patch cycle.”

#server-panel #self-hosted #devops #ai-management
INFRASTRUCTURE

exo-explore/exo ↗

★ 47,924

Decentralized local AI cluster engine that pools VRAM across Mac, Linux, and Windows hardware to run 70B+ models locally.

Why It's Essential:

“Renting eight H100 GPUs costs upwards of $24/hr, which breaks small Indian agency unit economics. Exo lets me daisy-chain an M3 Max MacBook with two RTX 4090 desktop workstations over 2.5GbE LAN to run DeepSeek 67B and Llama 3 70B across combined unified memory with zero cloud billing.”

#local-ai #distributed #clustering #hardware #vram
INFRASTRUCTURE

astral-sh/uv ↗

★ 90,814

Ultra-fast Python package and virtual environment manager written in Rust, replacing pip, pip-tools, and virtualenv.

Why It's Essential:

“In my Junagadh lab, Docker builds for local AI agent sandboxes used to stall for 8 minutes just resolving torch and cuda wheels over Indian broadband. Switching our agent deployment Dockerfiles to uv cut cold container build times down to 14 seconds flat. Every client AI script I ship now specifies uv inline script metadata.”

#python #rust #packaging #tooling #performance
INFRASTRUCTURE

Osmantic/ODS ↗

★ 8,400

Local AI stack installer — wires Ollama + Open WebUI + adjacent services in one command instead of hand assembly.

Why It's Essential:

“I ship Junagadh VPCs with 90-day ledger — ODS saves me 3 hours per Pi 5 setup by wiring Ollama, WebUI, and pgvector correctly on first try. Its compose template is what I fork for client on-prem installs.”

#ollama #open-webui #local-stack #installer
★ 4,000

Open source inference server that runs best local models for your hardware — profiles chip/RAM, recommends quant, plugged into Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code.

Why It's Essential:

“I ship offline-first 70B on laptop + 62 tok/s Pi 5 from Junagadh — magnitude profiles my hardware and picks the quant that fits before download, saving 3h per setup vs guessing Ollama. Its Apache-2.0 server + load-on-demand is why 78% of my calls stay inside VPC offline.”

#inference #local-llm #ollama #hardware-fit
INFRASTRUCTURE

tetherto/qvac ↗

★ 616

Local-first peer-to-peer AI: JS/TS plus Python clients running GGUF chat, RAG, speech, translation, and image tasks on Linux, macOS, Windows, Android, iOS, or delegating to peers; OpenAI-compatible HTTP server. When NOT to use: skip where sub-100ms cloud latency with frontier models is required — on-device quants trade raw quality for privacy and offline reach.

Why It's Essential:

“I ship for Gujarat shops with patchy 4G where cloud calls die mid-quotation, so on-device GGUF plus peer delegation is a real deployment shape. I tested the OpenAI-compatible server as a drop-in for my Pi 5 harness at 62 tok/s and kept 80 percent of calls inside the VPC. I still route final drafting to cloud models — small quants draft, frontier models close.”

#local-ai #p2p #gguf #offline
★ 18,209

OpenLogi — native, local-first alternative stack. Rust, 18.2k stars, +2.5k week Sep 18 2026.

Why It's Essential:

“I prefer local-first for Gujarat client demos on patchy 4G, and my Pi 5 harness at 62 tok/s proves small plus local wins attention. OpenLogi packaging that philosophy natively in Rust is the install shape I would hand a Rajkot engineering client tired of cloud bills. I would benchmark it against my VPS parity rig before recommending the switch.”

#local-first #rust #self-hosted #alternative-stack
★ 37,216

Fast serving engine and programming system for LLMs with RadixAttention for multi-turn KV cache reuse and structured JSON decoding.

Why It's Essential:

“In complex multi-turn agent loops with large system prompts, standard vLLM re-computes attention prefixes across repeated tool calls. SGLang’s RadixAttention preserves the shared prompt tree in GPU memory, cutting P95 inference latency from 1.4s down to 420ms on my 8-node local evaluation rig.”

#inference #serving #radix-attention #structured-decoding #cuda
← AI Skills Library Architecture Blueprints → ← Back home