LLM Gateway: open-source projects on GitHub
29 repositories on LLM Gateway, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
ONE GATEWAY — 375 AI PROVIDERS
OmniRoute — free MIT gateway with one endpoint to 375 providers (150+ free) and 1400+ models. Supports Claude Code, Cursor, Copilot. Quota-aware fallback and RTK+Caveman
★ 87,451 · TypeScriptUnified LLM Gateway
Python SDK and proxy server for invoking 100+ LLMs via an OpenAI‑compatible API, with cost tracking, security, load balancing, and logging.
★ 46,602 · PythonKong API Gateway
An open API and AI gateway for managing traffic, securing services, and extending functionality via plugins.
★ 43,377 · LuaPortkey-AI gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
★ 11,847 · TypeScriptTYK OPEN AI GATEWAY.
Tyk is an open‑source API and AI gateway that handles REST, GraphQL, TCP, gRPC and MCP traffic. It provides traffic management, authentication, and scalable deployment in
★ 10,886 · GoAI Code Without Limits
Endless free AI coding: connect any IDE to Claude/GPT/Gemini via 40+ providers with auto‑fallback and 40% token savings.
★ 9,759 · JavaScriptPLANO: AI PROXY FOR AGENTS
AI-native proxy and data plane for agent applications with orchestration and security.
★ 6,567 · RustGateway for corporate AI
The fastest AI gateway: 50x faster than LiteLLM, support for 1000+ models, load balancing, cluster mode, limits and overhead under 100 µs at 5k RPS.
★ 5,089 · GoWINDSURFAPI - PROXY FOR LLM API
A proxy server compatible with OpenAI and Anthropic APIs, making it easy to integrate LLM into any applications.
★ 3,140 · JavaScriptAPIPARK AI GATEWAY NEW GENERATION
APIPark — gateway for all models: single entry, LLM request management, load balancing and failover. Supports OpenAI, Claude, Gemini, DeepSeek and more, giving unified re
★ 1,826 · TypeScriptPARITOK-4B: REDUCING TOKEN USAGE 90%
Lossless code compression gateway cuts AI agents' token usage by 25% per turn and up to 90%+ in long sessions. Open 4B model, ready to use with Claude Code, Cursor, Codex
★ 1,446 · PythonLLMGATEWAY: UNIFIED API FOR ALL LLM
Manage requests to different LLM providers through a single unified interface. 1.2K ⭐ on GitHub.
★ 1,252 · TypeScriptLOCAL GATEWAY CLAUDE
ThinkWatch-Lite — local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux. Switches upstreams without touching clients, keeps API keys from
★ 1,070 · TypeScriptOTARI: GATEWAY FOR 40+ PROVIDERS
Self-hosted gateway compatible with OpenAI API, unifying over 40 LLM providers with virtual keys, budgets, and usage analytics.
★ 930 · PythonGOMODEL: AI-GATEWAY IN GO
Lightweight unified API gateway for OpenAI, Anthropic, Gemini, Groq, xAI and Ollama. Alternative to LiteLLM with monitoring, guardrails and cost tracking.
★ 909 · GoONE GATEWAY FOR ALL LLMS
respan-gateway — a single endpoint for all LLM providers. Supports any SDK, any model, and tools. One Rust binary replaces dozens of integrations.
★ 833 · RustNADIRCLAW: LLM Routing for Savings
Routes queries to cheap local models and premium LLMs, saving 40‑70% on API costs.
★ 504 · PythonHIROUTE — SMART AI MODEL ROUTER
Local router routes routine tasks to cheap models, complex ones to powerful. Reduces Codex and Claude Code subscription costs while preserving quality. Written in Rust.
★ 465 · RustFASTEST AI GATEWAY ON RUST
Antirion — open-source AI gateway in a single Rust binary. Routes, secures, budgets and observes every LLM call: OpenAI, Anthropic, Gemini, Bedrock. Built-in management c
★ 462 · RustCCPROXY Mods for Claude Code
ccproxy allows intercepting any requests to Claude Code and modifying responses, as well as connecting your own models via /model.
★ 360 · Python1FLOWBASE AGENT PLATFORM ON RUST
Open-source full-stack for AI agents: gateways, backend, React blocks, auto-generated CRUD and tracing.
★ 293 · RustAI-GATEWAY: Unified LLM Gateway
Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.
★ 291 · GoAI Router & Token-Saving Gateway
Single-binary Go router directing Claude Code, Cursor, and Codex across 155 providers with 20-40% token savings.
★ 244 · GoBITROUTER - ACCELERATE AGENT LOOPS
BitRouter is an open gateway and router for LLM agents in Rust, optimizing any workflows and compatible with any models.
★ 239 · RustBUSBAR: MANAGING AI AGENTS
busbar is the execution control plane for AI agents, controlling each model request, MCP tool call, A2A delegation, and subsequent action while preserving all native LLM
★ 222 · RustOPEN SOURCE AI GATEWAY IN RUST
aisix — a single OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock. Supports routing, guardrails, caching, rate limits, and observability. 201 stars on GitHub.
★ 220 · RustLOCAL LLM PROXY WITH COST CONTROL
Local LLM proxy measures the cost of each agent run and stops those that exceed the budget. Free, MIT‑licensed, written in TypeScript and already has 201 stars on GitHub.
★ 212 · TypeScriptClaude Code Gateway Bridge
Connects Claude Code CLI to Google Gemini models via Anthropic Messages API with observability.
★ 170 · PythonAI Inference Gateway
Synapass is a Go‑based AI inference gateway that routes requests across multiple LLM providers, applies policies, caches responses, and provides observability.
★ 98 · GoNew projects on this topic in Telegram
Telegram →