AIGo★ 295⑂ 120 forks
luqman-v1/9router-go
9ROUTER-GO GATEWAY FOR LLM ROUTING
A high‑performance Go proxy routes LLM requests to Claude, DeepSeek, GPT and other models. It delivers up to 32 000 RPS at only 42 MB RAM, is CGO‑free, and supports flexible rule‑based routing with real‑time metrics.
// KEY FEATURES
- Throughput up to 32 000 RPS when routing LLM requests via the proxy gateway.
- Consumes only 42 MB RAM via an efficient CGO‑free Go implementation.
- Supports rule‑based routing to Claude, DeepSeek, GPT and other LLM providers.
- Exports metrics to Prometheus and health‑checks via HTTP endpoint.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram