AIGo★ 315⑂ 89 forksApache-2.0
sgl-project/rbg
RGB - Scaling LLM Services
A Go package enabling fast deployment of LLM services on Kubernetes with minimal setup.
// KEY FEATURES
- Helm-based deployment support
- Auto-scaling based on request load
- Integration with Prometheus and Grafana
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram