R_REDDYX.XYZ
AIGo★ 315⑂ 89 forksApache-2.0

sgl-project/rbg

RGB - Scaling LLM Services

A Go package enabling fast deployment of LLM services on Kubernetes with minimal setup.

// KEY FEATURES

  • Helm-based deployment support
  • Auto-scaling based on request load
  • Integration with Prometheus and Grafana
#k8s#llm#pd-disagg#sglang
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

KANDEV: AI Kanban Development★ 315PLAMEN – AUTOMATIC WEB3 AUDITOR★ 315MCP SERVERS ON NIX★ 315GRAPH RAG FROM NEURIPS'25★ 315LOCAL MEMORY FOR AI AGENTS★ 315GREYWALL — SAFELY ISOLATE AI AGENTS★ 315

← FULL CATALOG

sgl-project/rbg — RGB - Scaling LLM Services | REDDYX AI