AIPython★ 943
lightseekorg/tokenspeed
Ultra-fast engine
Ultra-fast LLM inference engine in Python with maximum performance. 943 stars on GitHub.
// KEY FEATURES
- Implemented in Python
- Maximum inference speed
- Support for modern LLMs
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram