AIPython★ 69
zimingttkx/QuantumFlow
QuantumFlow: Distributed LLM Inference
A distributed framework for LLM inference scheduling with support for multiple backends and adaptive strategies.
// KEY FEATURES
- Support for vLLM, TGI, SGLang
- Adaptive scheduling strategies
- Cluster management
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram