AIPython★ 268⑂ 70 forksMIT
lightseekorg/TorchSpec
TORCHSPEC SPECULATIVE DECODING
PyTorch library for training speculative decoding models, accelerating text generation.
// KEY FEATURES
- Native PyTorch integration for easy use
- Support for various speculative decoding architectures
- Automatic generation acceleration without quality loss
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram