AI Infrastructure: open-source projects on GitHub
18 repositories on AI Infrastructure, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
AI Infrastructure Book
Open‑source Chinese book on AI infrastructure, covering LLM inference and training system design with quantitative analysis, plus PDF, code tools, and experiments.
★ 7,748 · PythonAIRWEAVE: AI AGENTS GITHUB CONTEXT
Open context extraction layer for AI agents. Python tool with 6K+ stars!
★ 6,379 · PythonSkillhub - Skill Registry
Self-hosted skill registry for corporate agents: versions, RBAC, audit, deployment in Docker/K8s.
★ 5,428 · JavaMEMORY FOR LLM APPS
LongMemory — local persistent memory store for LLM applications (Claude Desktop, GitHub Copilot, Codex, Antigravity). Fast search, context retention, and synchronization
★ 4,579 · TypeScriptHARNESSROUTER UNIFIED API FOR AGENTS
HarnessRouter Community Edition — implementation under Apache‑2.0 of a unified API for agents. Runs Codex, Claude Code, Hermes, PI, DSH through a single API with sessions
★ 4,362 · PythonLocal Memory for LLMs
Persistent memory storage for applications with LLMs: Claude Desktop, GitHub Copilot, Codex and others. Runs locally on your device.
★ 4,116 · TypeScriptLLM Token Compression
A 14‑stage pipeline for reversible LLM token compression with AST support and intelligent content routing, requiring no inference overhead.
★ 2,206 · PythonPARITOK-4B: REDUCING TOKEN USAGE 90%
Lossless code compression gateway cuts AI agents' token usage by 25% per turn and up to 90%+ in long sessions. Open 4B model, ready to use with Claude Code, Cursor, Codex
★ 1,446 · PythonSEMANTICA AI-KNOWLEDGE GRAPH
Semantica — a framework for building AI‑enhanced semantic graphs, enabling semantic search, ontological inference, and explainable AI.
★ 1,179 · PythonCAURA Shared AI Memory
Caura provides managed shared memory for AI agent fleets with multi‑tenant support, trust policies, and an audit trail.
★ 559 · PythonCOMPANION FOR SYSTEM DESIGN
Free open-source repository supplementing the Grokking the System Design Interview course. Materials and examples for preparing for system design.
★ 394AI-GATEWAY: Unified LLM Gateway
Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.
★ 291 · GoVESTI – MEMORY FOR AI CHATS
Local memory hub for AI conversations: saves, searches, summarizes, and exports chats from all popular platforms.
★ 288 · TypeScriptDASHCLAW: WALL FOR AI AGENTS
DashClaw intercepts AI agent actions and provides security policies. 273 stars on GitHub.
★ 273 · JavaScriptHOMELAB MONITOR DASHBOARD
Plug‑and‑play dashboard for homelab in a single container: monitoring GPU, local‑AI VRAM, Docker, systemd and host health. Built‑in read‑only MCP server gives AI agents a
★ 236 · PythonLLM TRAINING ACCELERATION ON SUPERPOD
Framework for distributed LLM training with SuperPod topology awareness. Optimizes process placement and inter-GPU communication. Supports PyTorch and scales to thousands
★ 214 · PythonTEMPORALSTORE FOR LLM CONTEXT
TemporalStore is an open-source Rust project designed for managing the context of large language models. It provides temporal functions for tracking context changes and r
★ 212 · PythonMUXI Infrastructure for AI
An open platform for deploying AI agents in production. Simple integration, scalability, and monitoring.
★ 179New projects on this topic in Telegram
Telegram →