AIPython★ 4,092
ModelTC/LightLLM
LightLLM - Fast LLM Inference
A lightweight and fast framework for inference and serving of large language models in Python. Simple scaling and high performance.
// KEY FEATURES
- Lightweight and fast LLM inference
- Simple scaling
- High performance
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram