AIPython★ 907
tanishqkumar/ssd
Lightweight SSD Inference Engine
A compact inference engine with speculative decoding support. Written in Python.
// KEY FEATURES
- Speculative decoding
- Lightweight and fast
- Written in Python
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram