R_REDDYX.XYZ

LLM Gateway: open-source projects on GitHub

29 repositories on LLM Gateway, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

AI Gateway 47Openai 690LLM 2094Anthropic 452LLM Proxy 18Claude Code 1595LLMOps 82MCP 1601Gemini 348Openai Compatible 41Claude 978Codex 849Gateway 24MCP Gateway 26
cheaper-inference/OmniRoute

ONE GATEWAY — 375 AI PROVIDERS

OmniRoute — free MIT gateway with one endpoint to 375 providers (150+ free) and 1400+ models. Supports Claude Code, Cursor, Copilot. Quota-aware fallback and RTK+Caveman

★ 87,451 · TypeScript
BerriAI/litellm

Unified LLM Gateway

Python SDK and proxy server for invoking 100+ LLMs via an OpenAI‑compatible API, with cost tracking, security, load balancing, and logging.

★ 46,602 · Python
Kong/kong

Kong API Gateway

An open API and AI gateway for managing traffic, securing services, and extending functionality via plugins.

★ 43,377 · Lua
Portkey-AI/gateway

Portkey-AI gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

★ 11,847 · TypeScript
TykTechnologies/tyk

TYK OPEN AI GATEWAY.

Tyk is an open‑source API and AI gateway that handles REST, GraphQL, TCP, gRPC and MCP traffic. It provides traffic management, authentication, and scalable deployment in

★ 10,886 · Go
decolua/9router

AI Code Without Limits

Endless free AI coding: connect any IDE to Claude/GPT/Gemini via 40+ providers with auto‑fallback and 40% token savings.

★ 9,759 · JavaScript
katanemo/plano

PLANO: AI PROXY FOR AGENTS

AI-native proxy and data plane for agent applications with orchestration and security.

★ 6,567 · Rust
maximhq/bifrost

Gateway for corporate AI

The fastest AI gateway: 50x faster than LiteLLM, support for 1000+ models, load balancing, cluster mode, limits and overhead under 100 µs at 5k RPS.

★ 5,089 · Go
dwgx/WindsurfAPI

WINDSURFAPI - PROXY FOR LLM API

A proxy server compatible with OpenAI and Anthropic APIs, making it easy to integrate LLM into any applications.

★ 3,140 · JavaScript
APIParkLab/APIPark

APIPARK AI GATEWAY NEW GENERATION

APIPark — gateway for all models: single entry, LLM request management, load balancing and failover. Supports OpenAI, Claude, Gemini, DeepSeek and more, giving unified re

★ 1,826 · TypeScript
Paritok-official/paritok-4b-v1

PARITOK-4B: REDUCING TOKEN USAGE 90%

Lossless code compression gateway cuts AI agents' token usage by 25% per turn and up to 90%+ in long sessions. Open 4B model, ready to use with Claude Code, Cursor, Codex

★ 1,446 · Python
theopenco/llmgateway

LLMGATEWAY: UNIFIED API FOR ALL LLM

Manage requests to different LLM providers through a single unified interface. 1.2K ⭐ on GitHub.

★ 1,252 · TypeScript
ThinkWatchProject/ThinkWatch-Lite

LOCAL GATEWAY CLAUDE

ThinkWatch-Lite — local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux. Switches upstreams without touching clients, keeps API keys from

★ 1,070 · TypeScript
mozilla-ai/otari

OTARI: GATEWAY FOR 40+ PROVIDERS

Self-hosted gateway compatible with OpenAI API, unifying over 40 LLM providers with virtual keys, budgets, and usage analytics.

★ 930 · Python
ENTERPILOT/GoModel

GOMODEL: AI-GATEWAY IN GO

Lightweight unified API gateway for OpenAI, Anthropic, Gemini, Groq, xAI and Ollama. Alternative to LiteLLM with monitoring, guardrails and cost tracking.

★ 909 · Go
respanai/respan-gateway

ONE GATEWAY FOR ALL LLMS

respan-gateway — a single endpoint for all LLM providers. Supports any SDK, any model, and tools. One Rust binary replaces dozens of integrations.

★ 833 · Rust
NadirRouter/NadirClaw

NADIRCLAW: LLM Routing for Savings

Routes queries to cheap local models and premium LLMs, saving 40‑70% on API costs.

★ 504 · Python
higress-group/HiRoute

HIROUTE — SMART AI MODEL ROUTER

Local router routes routine tasks to cheap models, complex ones to powerful. Reduces Codex and Claude Code subscription costs while preserving quality. Written in Rust.

★ 465 · Rust
eliasbiondo/antirion

FASTEST AI GATEWAY ON RUST

Antirion — open-source AI gateway in a single Rust binary. Routes, secures, budgets and observes every LLM call: OpenAI, Anthropic, Gemini, Bedrock. Built-in management c

★ 462 · Rust
starbaser/ccproxy

CCPROXY Mods for Claude Code

ccproxy allows intercepting any requests to Claude Code and modifying responses, as well as connecting your own models via /model.

★ 360 · Python
taichuy/1flowbase

1FLOWBASE AGENT PLATFORM ON RUST

Open-source full-stack for AI agents: gateways, backend, React blocks, auto-generated CRUD and tracing.

★ 293 · Rust
ferro-labs/ai-gateway

AI-GATEWAY: Unified LLM Gateway

Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.

★ 291 · Go
yanstd888/9routerx

AI Router & Token-Saving Gateway

Single-binary Go router directing Claude Code, Cursor, and Codex across 155 providers with 20-40% token savings.

★ 244 · Go
bitrouter/bitrouter

BITROUTER - ACCELERATE AGENT LOOPS

BitRouter is an open gateway and router for LLM agents in Rust, optimizing any workflows and compatible with any models.

★ 239 · Rust
GetBusbar/busbar

BUSBAR: MANAGING AI AGENTS

busbar is the execution control plane for AI agents, controlling each model request, MCP tool call, A2A delegation, and subsequent action while preserving all native LLM

★ 222 · Rust
api7/aisix

OPEN SOURCE AI GATEWAY IN RUST

aisix — a single OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock. Supports routing, guardrails, caching, rate limits, and observability. 201 stars on GitHub.

★ 220 · Rust
RelayPlane/proxy

LOCAL LLM PROXY WITH COST CONTROL

Local LLM proxy measures the cost of each agent run and stops those that exceed the budget. Free, MIT‑licensed, written in TypeScript and already has 201 stars on GitHub.

★ 212 · TypeScript
sksarvesh007/antiglaude

Claude Code Gateway Bridge

Connects Claude Code CLI to Google Gemini models via Anthropic Messages API with observability.

★ 170 · Python
ShadowSafin/Synapass

AI Inference Gateway

Synapass is a Go‑based AI inference gateway that routes requests across multiple LLM providers, applies policies, caches responses, and provides observability.

★ 98 · Go

New projects on this topic in Telegram

Telegram →
LLM Gateway — 29 open-source GitHub projects | REDDYX AI