R_REDDYX.XYZ

AI Infrastructure: open-source projects on GitHub

18 repositories on AI Infrastructure, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094AI Agents 1319RAG 533Developer Tools 620Agent Framework 89AI Memory 62Openai 690MCP 1601Openclaw 241Gemini 348Memory 133Ollama 249Self Hosted 359Agentic AI 378
bojieli/ai-infra-book

AI Infrastructure Book

Open‑source Chinese book on AI infrastructure, covering LLM inference and training system design with quantitative analysis, plus PDF, code tools, and experiments.

★ 7,748 · Python
airweave-ai/airweave

AIRWEAVE: AI AGENTS GITHUB CONTEXT

Open context extraction layer for AI agents. Python tool with 6K+ stars!

★ 6,379 · Python
iflytek/skillhub

Skillhub - Skill Registry

Self-hosted skill registry for corporate agents: versions, RBAC, audit, deployment in Docker/K8s.

★ 5,428 · Java
CaviraOSS/LongMemory

MEMORY FOR LLM APPS

LongMemory — local persistent memory store for LLM applications (Claude Desktop, GitHub Copilot, Codex, Antigravity). Fast search, context retention, and synchronization

★ 4,579 · TypeScript
HarnessRouter/harnessrouter

HARNESSROUTER UNIFIED API FOR AGENTS

HarnessRouter Community Edition — implementation under Apache‑2.0 of a unified API for agents. Runs Codex, Claude Code, Hermes, PI, DSH through a single API with sessions

★ 4,362 · Python
CaviraOSS/OpenMemory

Local Memory for LLMs

Persistent memory storage for applications with LLMs: Claude Desktop, GitHub Copilot, Codex and others. Runs locally on your device.

★ 4,116 · TypeScript
open-compress/claw-compactor

LLM Token Compression

A 14‑stage pipeline for reversible LLM token compression with AST support and intelligent content routing, requiring no inference overhead.

★ 2,206 · Python
Paritok-official/paritok-4b-v1

PARITOK-4B: REDUCING TOKEN USAGE 90%

Lossless code compression gateway cuts AI agents' token usage by 25% per turn and up to 90%+ in long sessions. Open 4B model, ready to use with Claude Code, Cursor, Codex

★ 1,446 · Python
semantica-agi/semantica

SEMANTICA AI-KNOWLEDGE GRAPH

Semantica — a framework for building AI‑enhanced semantic graphs, enabling semantic search, ontological inference, and explainable AI.

★ 1,179 · Python
caura-ai/caura

CAURA Shared AI Memory

Caura provides managed shared memory for AI agent fleets with multi‑tenant support, trust policies, and an audit trail.

★ 559 · Python
design-gurus/grokking-system-design

COMPANION FOR SYSTEM DESIGN

Free open-source repository supplementing the Grokking the System Design Interview course. Materials and examples for preparing for system design.

★ 394
ferro-labs/ai-gateway

AI-GATEWAY: Unified LLM Gateway

Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.

★ 291 · Go
abraxas914/VESTI

VESTI – MEMORY FOR AI CHATS

Local memory hub for AI conversations: saves, searches, summarizes, and exports chats from all popular platforms.

★ 288 · TypeScript
ucsandman/DashClaw

DASHCLAW: WALL FOR AI AGENTS

DashClaw intercepts AI agent actions and provides security policies. 273 stars on GitHub.

★ 273 · JavaScript
SikamikanikoBG/homelab-monitor

HOMELAB MONITOR DASHBOARD

Plug‑and‑play dashboard for homelab in a single container: monitoring GPU, local‑AI VRAM, Docker, systemd and host health. Built‑in read‑only MCP server gives AI agents a

★ 236 · Python
mindspore-ai/hyper-parallel

LLM TRAINING ACCELERATION ON SUPERPOD

Framework for distributed LLM training with SuperPod topology awareness. Optimizes process placement and inter-GPU communication. Supports PyTorch and scales to thousands

★ 214 · Python
matrixarkai/TemporalStore

TEMPORALSTORE FOR LLM CONTEXT

TemporalStore is an open-source Rust project designed for managing the context of large language models. It provides temporal functions for tracking context changes and r

★ 212 · Python
muxi-ai/muxi

MUXI Infrastructure for AI

An open platform for deploying AI agents in production. Simple integration, scalability, and monitoring.

★ 179

New projects on this topic in Telegram

Telegram →
AI Infrastructure — 18 open-source GitHub projects | REDDYX AI