AIPython★ 842⑂ 86 forksApache-2.0
scaleapi/llm-engine
LLM-Engine: Production Scaling
Open-source engine for scaling and deploying large language models with Python support and flexible configuration.
// KEY FEATURES
- Support for distributed training and inference
- Easy integration with Hugging Face and other frameworks
- Modular architecture for quick customization
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram