R_REDDYX.XYZ

AI Gateway: open-source projects on GitHub

47 repositories on AI Gateway, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Openai 690LLM Gateway 29Anthropic 452Claude Code 1595MCP 1601LLMOps 82LLM Proxy 18Openai Compatible 41MCP Gateway 26API Gateway 29Self Hosted 359Codex 849Gemini 348
cheaper-inference/OmniRoute

ONE GATEWAY — 375 AI PROVIDERS

OmniRoute — free MIT gateway with one endpoint to 375 providers (150+ free) and 1400+ models. Supports Claude Code, Cursor, Copilot. Quota-aware fallback and RTK+Caveman

★ 87,451 · TypeScript
BerriAI/litellm

Unified LLM Gateway

Python SDK and proxy server for invoking 100+ LLMs via an OpenAI‑compatible API, with cost tracking, security, load balancing, and logging.

★ 46,602 · Python
Kong/kong

Kong API Gateway

An open API and AI gateway for managing traffic, securing services, and extending functionality via plugins.

★ 43,377 · Lua
QuantumNous/new-api

Unified AI Model Gateway

Unified center for aggregation and distribution of AI models. It enables conversion of any LLM to OpenAI, Claude, and Gemini formats.

★ 32,817 · Go
casdoor/casdoor

CASDOOR — IAM FOR AI AGENTS

Open IAM server with a web interface: OAuth, OIDC, SAML, LDAP, MCP, MFA, and integrations with LLM agents.

★ 13,687 · Go
Portkey-AI/gateway

Portkey-AI gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

★ 11,847 · TypeScript
TykTechnologies/tyk

TYK OPEN AI GATEWAY.

Tyk is an open‑source API and AI gateway that handles REST, GraphQL, TCP, gRPC and MCP traffic. It provides traffic management, authentication, and scalable deployment in

★ 10,886 · Go
decolua/9router

AI Code Without Limits

Endless free AI coding: connect any IDE to Claude/GPT/Gemini via 40+ providers with auto‑fallback and 40% token savings.

★ 9,759 · JavaScript
katanemo/plano

PLANO: AI PROXY FOR AGENTS

AI-native proxy and data plane for agent applications with orchestration and security.

★ 6,567 · Rust
weave-os/router

FAST MODEL ROUTER FOR AGENTS

Router directs each prompt to the optimal model in under 50 ms, cutting costs by 40‑70 % with a simple endpoint change. Implemented in Go, it has already earned 4174 star

★ 5,622 · Go
maximhq/bifrost

Gateway for corporate AI

The fastest AI gateway: 50x faster than LiteLLM, support for 1000+ models, load balancing, cluster mode, limits and overhead under 100 µs at 5k RPS.

★ 5,089 · Go
vllm-project/semantic-router

Intelligent System Router

An intelligent router for managing mixed models in the cloud, data centers, and at the edge.

★ 4,182 · Go
seakee/CPA-Manager-Plus

MONITORING AI GATEWAYS WITH AI

Self-hosted dashboard for tracking requests, cost, errors, and quotas of CPA/CLIProxyAPI and OpenAI-compatible gateways.

★ 4,085 · TypeScript
nextlevelbuilder/goclaw

GOCLAW: Go AI Agents Instantly

GoClaw is OpenClaw rewritten in Go with multi-user isolation and 5-level security for scalable deployment of AI-agent teams.

★ 3,188 · Go
agentgateway/agentgateway

AgentGateway: Proxy for AI Agents

AgentGateway is a new Rust proxy server that simplifies interaction between AI agents and MCP servers. It supports scalable routing and low latency.

★ 2,871 · Rust
Continuum-AI-Corp/OrcaRouter-Lite

ORCALITE LLM ROUTER SELF-HOSTED

Self-hosted LLM router with managed safety net and OpenAI‑compatible API. Supports BYOK, a single workspace, and streaming generation. For advanced routing use the hosted

★ 2,794 · Python
theagentrouter/agent-router

UNIFIED GATEWAY FOR AI SERVICES

agent-router is an Envoy Gateway‑based gateway that provides unified access to various generative AI services. Implemented in Go, it runs in Kubernetes and adheres to CNC

★ 2,404 · Go
kaitranntt/ccs

Multi-AI CLI Proxy

Switch between Claude, Gemini, Copilot, and 300+ models via CLIProxyAPI OAuth proxy with a visual dashboard and remote proxy support.

★ 2,364 · TypeScript
APIParkLab/APIPark

APIPARK AI GATEWAY NEW GENERATION

APIPark — gateway for all models: single entry, LLM request management, load balancing and failover. Supports OpenAI, Claude, Gemini, DeepSeek and more, giving unified re

★ 1,826 · TypeScript
envoyproxy/ai-gateway

AI-GATEWAY: UNIFIED GATEWAY FOR AI

The ai-gateway project provides unified access to various generative AI services via Envoy Gateway, written in Go.

★ 1,717 · Go
LiteLLM-Labs/litellm-agent-control-plane

Unified Agent Control Plane

Manage all agents from a single place.

★ 1,332 · Rust
theopenco/llmgateway

LLMGATEWAY: UNIFIED API FOR ALL LLM

Manage requests to different LLM providers through a single unified interface. 1.2K ⭐ on GitHub.

★ 1,252 · TypeScript
ThinkWatchProject/ThinkWatch-Lite

LOCAL GATEWAY CLAUDE

ThinkWatch-Lite — local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux. Switches upstreams without touching clients, keeps API keys from

★ 1,070 · TypeScript
kittors/CliRelay

CLIRELAY - UNIFIED GATEWAY FOR AI CODING

Self-hosted AI gateway unifies OpenAI, Claude, Gemini, and Codex in a single endpoint with a web console, request logs, and cost quotas.

★ 1,055 · Go
future-agi/future-agi

AI Application Evaluation

Open platform for evaluating and improving LLM and AI agents with tracing, simulation, and dataset support. Runs locally.

★ 971 · Python
mozilla-ai/otari

OTARI: GATEWAY FOR 40+ PROVIDERS

Self-hosted gateway compatible with OpenAI API, unifying over 40 LLM providers with virtual keys, budgets, and usage analytics.

★ 930 · Python
gotempsh/temps

TEMPS: ONE TRUE AI-PLATFORM

Temps is an open AI-native platform built with Rust that unifies deployment, analytics, error tracking, and sandboxes in a single self-contained binary.

★ 917 · Rust
ENTERPILOT/GoModel

GOMODEL: AI-GATEWAY IN GO

Lightweight unified API gateway for OpenAI, Anthropic, Gemini, Groq, xAI and Ollama. Alternative to LiteLLM with monitoring, guardrails and cost tracking.

★ 909 · Go
ThinkWatchProject/ThinkWatch

ThinkWatch: AI Bastion Host

Enterprise bastion for secure access to AI API and MCP with unified proxy service, RBAC, audit, rate limiting, and cost tracking. Supports OpenAI, Anthropic, Gemini, and

★ 868 · Rust
respanai/respan-gateway

ONE GATEWAY FOR ALL LLMS

respan-gateway — a single endpoint for all LLM providers. Supports any SDK, any model, and tools. One Rust binary replaces dozens of integrations.

★ 833 · Rust
higress-group/HiRoute

HIROUTE — SMART AI MODEL ROUTER

Local router routes routine tasks to cheap models, complex ones to powerful. Reduces Codex and Claude Code subscription costs while preserving quality. Written in Rust.

★ 465 · Rust
eliasbiondo/antirion

FASTEST AI GATEWAY ON RUST

Antirion — open-source AI gateway in a single Rust binary. Routes, secures, budgets and observes every LLM call: OpenAI, Anthropic, Gemini, Bedrock. Built-in management c

★ 462 · Rust
caidaoli/ccLoad

CCLOAD: AI Gateway No Switch

AI gateway with smart routing, auto-failover, and real-time request monitoring.

★ 440 · Go
WizisCool/oh-my-cpa

OH-MY-CPA SELF-HOSTED AI GATEWAY

Self-hosted control plane and usage observability console for CLIProxyAPI (CPA). Connect AI providers, manage client keys, get streaming telemetry and model cost snapshot

★ 407 · TypeScript
routerhubSI/uncensored-ai-api

ALL LLMS IN ONE API

Gateway to Claude, GPT, Gemini, Grok, DeepSeek, GLM, Qwen and Kimi with one key. Supports uncensored and abliterated model variants. Compatible with OpenAI and Anthropic

★ 405
schmitech/orbit

ORBIT SELF-HOSTED AI

Orbit — self-hosted platform for private RAG and multimodal AI applications in Python.

★ 364 · Python
starbaser/ccproxy

CCPROXY Mods for Claude Code

ccproxy allows intercepting any requests to Claude Code and modifying responses, as well as connecting your own models via /model.

★ 360 · Python
taichuy/1flowbase

1FLOWBASE AGENT PLATFORM ON RUST

Open-source full-stack for AI agents: gateways, backend, React blocks, auto-generated CRUD and tracing.

★ 293 · Rust
ferro-labs/ai-gateway

AI-GATEWAY: Unified LLM Gateway

Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.

★ 291 · Go
w8123/EnterpriseAgentFramework

ENTERPRISE AI AGENT

Platform for registering business APIs as AI capabilities in Java/Spring Boot: creating agents via GraphSpec, MCP/A2A/Gateway and monitoring execution.

★ 273 · Java
yanstd888/9routerx

AI Router & Token-Saving Gateway

Single-binary Go router directing Claude Code, Cursor, and Codex across 155 providers with 20-40% token savings.

★ 244 · Go
LintenAI/linten

ONE API FOR 100+ MODELS

Linten is an open-source AI gateway with a single OpenAI-compatible API for 100+ models. Supports virtual keys, spend tracking, routing, and guardrails. Self-hosted deplo

★ 242 · Python
GetBusbar/busbar

BUSBAR: MANAGING AI AGENTS

busbar is the execution control plane for AI agents, controlling each model request, MCP tool call, A2A delegation, and subsequent action while preserving all native LLM

★ 222 · Rust
api7/aisix

OPEN SOURCE AI GATEWAY IN RUST

aisix — a single OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock. Supports routing, guardrails, caching, rate limits, and observability. 201 stars on GitHub.

★ 220 · Rust
ShadowSafin/Synapass

AI Inference Gateway

Synapass is a Go‑based AI inference gateway that routes requests across multiple LLM providers, applies policies, caches responses, and provides observability.

★ 98 · Go
1Panel-dev/1Panel-Gateway

1Panel AI Gateway

1Panel AI Gateway is a comprehensive solution for managing AI services: a single entry point, intelligent routing, and full compliance auditing, enabling secure, efficien

★ 86
hadihonarvar/flock

Self-hosted LLM gateway

A single Go binary turns your Mac and Linux machines into a private inference cluster featuring multi‑machine routing, sharding via llama.cpp‑RPC, and support for the Ope

★ 38 · Go

New projects on this topic in Telegram

Telegram →
AI Gateway — 47 open-source GitHub projects | REDDYX AI