LLM Proxy: open-source projects on GitHub
18 repositories on LLM Proxy, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
PLANO: AI PROXY FOR AGENTS
AI-native proxy and data plane for agent applications with orchestration and security.
★ 6,567 · RustWINDSURFAPI - PROXY FOR LLM API
A proxy server compatible with OpenAI and Anthropic APIs, making it easy to integrate LLM into any applications.
★ 3,140 · JavaScriptLLMGATEWAY: UNIFIED API FOR ALL LLM
Manage requests to different LLM providers through a single unified interface. 1.2K ⭐ on GitHub.
★ 1,252 · TypeScriptLOCAL GATEWAY CLAUDE
ThinkWatch-Lite — local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux. Switches upstreams without touching clients, keeps API keys from
★ 1,070 · TypeScriptCLIRELAY - UNIFIED GATEWAY FOR AI CODING
Self-hosted AI gateway unifies OpenAI, Claude, Gemini, and Codex in a single endpoint with a web console, request logs, and cost quotas.
★ 1,055 · GoOTARI: GATEWAY FOR 40+ PROVIDERS
Self-hosted gateway compatible with OpenAI API, unifying over 40 LLM providers with virtual keys, budgets, and usage analytics.
★ 930 · PythonONE GATEWAY FOR ALL LLMS
respan-gateway — a single endpoint for all LLM providers. Supports any SDK, any model, and tools. One Rust binary replaces dozens of integrations.
★ 833 · RustClaude-TAP: Agent Traffic
Intercept and analyze API traffic from Claude Code, Codex CLI, Gemini CLI, Cursor CLI, OpenCode, Kimi, Pi, and Hermes in a local trace viewer.
★ 788 · PythonAPI RELAY SECURITY SCANNER
Local scanner for AI API relays and LLM proxies. 620 ⭐ on GitHub.
★ 620 · PythonNADIRCLAW: LLM Routing for Savings
Routes queries to cheap local models and premium LLMs, saving 40‑70% on API costs.
★ 504 · PythonFASTEST AI GATEWAY ON RUST
Antirion — open-source AI gateway in a single Rust binary. Routes, secures, budgets and observes every LLM call: OpenAI, Anthropic, Gemini, Bedrock. Built-in management c
★ 462 · RustCCLOAD: AI Gateway No Switch
AI gateway with smart routing, auto-failover, and real-time request monitoring.
★ 440 · GoCCPROXY Mods for Claude Code
ccproxy allows intercepting any requests to Claude Code and modifying responses, as well as connecting your own models via /model.
★ 360 · PythonAI-GATEWAY: Unified LLM Gateway
Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.
★ 291 · GoGPROXY UNIFIED LLM GATEWAY
A multichannel Rust proxy unifies OpenAI, Claude, and Gemini APIs with an admin console and request tracking.
★ 287 · RustBUSBAR: MANAGING AI AGENTS
busbar is the execution control plane for AI agents, controlling each model request, MCP tool call, A2A delegation, and subsequent action while preserving all native LLM
★ 222 · RustOPEN SOURCE AI GATEWAY IN RUST
aisix — a single OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock. Supports routing, guardrails, caching, rate limits, and observability. 201 stars on GitHub.
★ 220 · RustLOCAL LLM PROXY WITH COST CONTROL
Local LLM proxy measures the cost of each agent run and stops those that exceed the budget. Free, MIT‑licensed, written in TypeScript and already has 201 stars on GitHub.
★ 212 · TypeScriptNew projects on this topic in Telegram
Telegram →