R_REDDYX.XYZ
AIGo★ 295⑂ 120 forks

luqman-v1/9router-go

9ROUTER-GO GATEWAY FOR LLM ROUTING

A high‑performance Go proxy routes LLM requests to Claude, DeepSeek, GPT and other models. It delivers up to 32 000 RPS at only 42 MB RAM, is CGO‑free, and supports flexible rule‑based routing with real‑time metrics.

// KEY FEATURES

  • Throughput up to 32 000 RPS when routing LLM requests via the proxy gateway.
  • Consumes only 42 MB RAM via an efficient CGO‑free Go implementation.
  • Supports rule‑based routing to Claude, DeepSeek, GPT and other LLM providers.
  • Exports metrics to Prometheus and health‑checks via HTTP endpoint.
#9router#api-gateway#claude#deepseek#gpt#llm#openai#proxy#sqlite#sse
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Multi-agent Trading LangGraph★ 295PACKMIND - AI FOR ENGINEERING PLAYBOOKS★ 295GOLEMBOT — AGENT EVERYWHERE★ 295FABRIKT: Kotlin from OpenAPI★ 295AWESOME RAG PRODUCTION★ 295JITLLM: HIGH PERFORMANCE LLM ON JVM★ 295

← FULL CATALOG

luqman-v1/9router-go — 9router-GO Gateway For LLM Routing