theagentrouter/agent-router

agent-router is an Envoy Gateway‑based gateway that provides unified access to various generative AI services. Implemented in Go, it runs in Kubernetes and adheres to CNCF standards for inference and API gateways.

// KEY FEATURES

• Routing requests to LLM providers via Envoy Proxy.
• Automatic transformation of request and response formats for each AI service.
• Security policies: authentication, request rate limiting, and token validation.
• Export metrics to Prometheus and tracing via OpenTelemetry for observability.

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.