AIGo★ 291⑂ 40 forksApache-2.0
ferro-labs/ai-gateway
AI-GATEWAY: Unified LLM Gateway
Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.
// KEY FEATURES
- Request caching to reduce latency and cost
- Guardrails and content filtering for security
- A/B testing and real-time cost control
#ai-gateway#ai-infrastructure#guardrails#litellm#llm#llm-cost#llm-gateway#llm-proxy#llm-strategy#llmops#mcp#openai-compatible
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram