AIPython★ 3,123
thu-pacman/chitu
CHITU: ACCELERATING LLMS IN PYTHON
High-performance framework for fast inference of large language models in Python. Provides flexibility, efficiency, and ease of deployment.
// KEY FEATURES
- Optimized engine for low latency
- Support for multiple backends and devices
- Simple API with flexible configuration
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram