AIPython★ 5,041
gpustack/gpustack
GPU cluster manager
Management of GPU clusters with automatic configuration and orchestration of inference engines (vLLM, SGLang) for high-performance deployment of AI models.
// KEY FEATURES
- Orchestration of vLLM and SGLang
- Automatic configuration of GPU clusters
- High inference performance
#ascend#cuda#deepseek#distributed-inference#genai#high-performance-inference#inference#llama#llm#llm-inference#llm-serving#maas
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram