AI Gateway: open-source projects on GitHub
47 repositories on AI Gateway, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
ONE GATEWAY — 375 AI PROVIDERS
OmniRoute — free MIT gateway with one endpoint to 375 providers (150+ free) and 1400+ models. Supports Claude Code, Cursor, Copilot. Quota-aware fallback and RTK+Caveman
★ 87,451 · TypeScriptUnified LLM Gateway
Python SDK and proxy server for invoking 100+ LLMs via an OpenAI‑compatible API, with cost tracking, security, load balancing, and logging.
★ 46,602 · PythonKong API Gateway
An open API and AI gateway for managing traffic, securing services, and extending functionality via plugins.
★ 43,377 · LuaUnified AI Model Gateway
Unified center for aggregation and distribution of AI models. It enables conversion of any LLM to OpenAI, Claude, and Gemini formats.
★ 32,817 · GoCASDOOR — IAM FOR AI AGENTS
Open IAM server with a web interface: OAuth, OIDC, SAML, LDAP, MCP, MFA, and integrations with LLM agents.
★ 13,687 · GoPortkey-AI gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
★ 11,847 · TypeScriptTYK OPEN AI GATEWAY.
Tyk is an open‑source API and AI gateway that handles REST, GraphQL, TCP, gRPC and MCP traffic. It provides traffic management, authentication, and scalable deployment in
★ 10,886 · GoAI Code Without Limits
Endless free AI coding: connect any IDE to Claude/GPT/Gemini via 40+ providers with auto‑fallback and 40% token savings.
★ 9,759 · JavaScriptPLANO: AI PROXY FOR AGENTS
AI-native proxy and data plane for agent applications with orchestration and security.
★ 6,567 · RustFAST MODEL ROUTER FOR AGENTS
Router directs each prompt to the optimal model in under 50 ms, cutting costs by 40‑70 % with a simple endpoint change. Implemented in Go, it has already earned 4174 star
★ 5,622 · GoGateway for corporate AI
The fastest AI gateway: 50x faster than LiteLLM, support for 1000+ models, load balancing, cluster mode, limits and overhead under 100 µs at 5k RPS.
★ 5,089 · GoIntelligent System Router
An intelligent router for managing mixed models in the cloud, data centers, and at the edge.
★ 4,182 · GoMONITORING AI GATEWAYS WITH AI
Self-hosted dashboard for tracking requests, cost, errors, and quotas of CPA/CLIProxyAPI and OpenAI-compatible gateways.
★ 4,085 · TypeScriptGOCLAW: Go AI Agents Instantly
GoClaw is OpenClaw rewritten in Go with multi-user isolation and 5-level security for scalable deployment of AI-agent teams.
★ 3,188 · GoAgentGateway: Proxy for AI Agents
AgentGateway is a new Rust proxy server that simplifies interaction between AI agents and MCP servers. It supports scalable routing and low latency.
★ 2,871 · RustORCALITE LLM ROUTER SELF-HOSTED
Self-hosted LLM router with managed safety net and OpenAI‑compatible API. Supports BYOK, a single workspace, and streaming generation. For advanced routing use the hosted
★ 2,794 · PythonUNIFIED GATEWAY FOR AI SERVICES
agent-router is an Envoy Gateway‑based gateway that provides unified access to various generative AI services. Implemented in Go, it runs in Kubernetes and adheres to CNC
★ 2,404 · GoMulti-AI CLI Proxy
Switch between Claude, Gemini, Copilot, and 300+ models via CLIProxyAPI OAuth proxy with a visual dashboard and remote proxy support.
★ 2,364 · TypeScriptAPIPARK AI GATEWAY NEW GENERATION
APIPark — gateway for all models: single entry, LLM request management, load balancing and failover. Supports OpenAI, Claude, Gemini, DeepSeek and more, giving unified re
★ 1,826 · TypeScriptAI-GATEWAY: UNIFIED GATEWAY FOR AI
The ai-gateway project provides unified access to various generative AI services via Envoy Gateway, written in Go.
★ 1,717 · GoUnified Agent Control Plane
Manage all agents from a single place.
★ 1,332 · RustLLMGATEWAY: UNIFIED API FOR ALL LLM
Manage requests to different LLM providers through a single unified interface. 1.2K ⭐ on GitHub.
★ 1,252 · TypeScriptLOCAL GATEWAY CLAUDE
ThinkWatch-Lite — local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux. Switches upstreams without touching clients, keeps API keys from
★ 1,070 · TypeScriptCLIRELAY - UNIFIED GATEWAY FOR AI CODING
Self-hosted AI gateway unifies OpenAI, Claude, Gemini, and Codex in a single endpoint with a web console, request logs, and cost quotas.
★ 1,055 · GoAI Application Evaluation
Open platform for evaluating and improving LLM and AI agents with tracing, simulation, and dataset support. Runs locally.
★ 971 · PythonOTARI: GATEWAY FOR 40+ PROVIDERS
Self-hosted gateway compatible with OpenAI API, unifying over 40 LLM providers with virtual keys, budgets, and usage analytics.
★ 930 · PythonTEMPS: ONE TRUE AI-PLATFORM
Temps is an open AI-native platform built with Rust that unifies deployment, analytics, error tracking, and sandboxes in a single self-contained binary.
★ 917 · RustGOMODEL: AI-GATEWAY IN GO
Lightweight unified API gateway for OpenAI, Anthropic, Gemini, Groq, xAI and Ollama. Alternative to LiteLLM with monitoring, guardrails and cost tracking.
★ 909 · GoThinkWatch: AI Bastion Host
Enterprise bastion for secure access to AI API and MCP with unified proxy service, RBAC, audit, rate limiting, and cost tracking. Supports OpenAI, Anthropic, Gemini, and
★ 868 · RustONE GATEWAY FOR ALL LLMS
respan-gateway — a single endpoint for all LLM providers. Supports any SDK, any model, and tools. One Rust binary replaces dozens of integrations.
★ 833 · RustHIROUTE — SMART AI MODEL ROUTER
Local router routes routine tasks to cheap models, complex ones to powerful. Reduces Codex and Claude Code subscription costs while preserving quality. Written in Rust.
★ 465 · RustFASTEST AI GATEWAY ON RUST
Antirion — open-source AI gateway in a single Rust binary. Routes, secures, budgets and observes every LLM call: OpenAI, Anthropic, Gemini, Bedrock. Built-in management c
★ 462 · RustCCLOAD: AI Gateway No Switch
AI gateway with smart routing, auto-failover, and real-time request monitoring.
★ 440 · GoOH-MY-CPA SELF-HOSTED AI GATEWAY
Self-hosted control plane and usage observability console for CLIProxyAPI (CPA). Connect AI providers, manage client keys, get streaming telemetry and model cost snapshot
★ 407 · TypeScriptALL LLMS IN ONE API
Gateway to Claude, GPT, Gemini, Grok, DeepSeek, GLM, Qwen and Kimi with one key. Supports uncensored and abliterated model variants. Compatible with OpenAI and Anthropic
★ 405ORBIT SELF-HOSTED AI
Orbit — self-hosted platform for private RAG and multimodal AI applications in Python.
★ 364 · PythonCCPROXY Mods for Claude Code
ccproxy allows intercepting any requests to Claude Code and modifying responses, as well as connecting your own models via /model.
★ 360 · Python1FLOWBASE AGENT PLATFORM ON RUST
Open-source full-stack for AI agents: gateways, backend, React blocks, auto-generated CRUD and tracing.
★ 293 · RustAI-GATEWAY: Unified LLM Gateway
Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.
★ 291 · GoENTERPRISE AI AGENT
Platform for registering business APIs as AI capabilities in Java/Spring Boot: creating agents via GraphSpec, MCP/A2A/Gateway and monitoring execution.
★ 273 · JavaAI Router & Token-Saving Gateway
Single-binary Go router directing Claude Code, Cursor, and Codex across 155 providers with 20-40% token savings.
★ 244 · GoONE API FOR 100+ MODELS
Linten is an open-source AI gateway with a single OpenAI-compatible API for 100+ models. Supports virtual keys, spend tracking, routing, and guardrails. Self-hosted deplo
★ 242 · PythonBUSBAR: MANAGING AI AGENTS
busbar is the execution control plane for AI agents, controlling each model request, MCP tool call, A2A delegation, and subsequent action while preserving all native LLM
★ 222 · RustOPEN SOURCE AI GATEWAY IN RUST
aisix — a single OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock. Supports routing, guardrails, caching, rate limits, and observability. 201 stars on GitHub.
★ 220 · RustAI Inference Gateway
Synapass is a Go‑based AI inference gateway that routes requests across multiple LLM providers, applies policies, caches responses, and provides observability.
★ 98 · Go1Panel AI Gateway
1Panel AI Gateway is a comprehensive solution for managing AI services: a single entry point, intelligent routing, and full compliance auditing, enabling secure, efficien
★ 86Self-hosted LLM gateway
A single Go binary turns your Mac and Linux machines into a private inference cluster featuring multi‑machine routing, sharding via llama.cpp‑RPC, and support for the Ope
★ 38 · GoNew projects on this topic in Telegram
Telegram →