AIPython★ 1,285⑂ 393 forksMIT
sgl-project/SpecForge
QUICKLY TRAIN SPECULATIVE DECODER
SpecForge simplifies training speculative decoding models and exporting them to SGLang for high-performance serving.
// KEY FEATURES
- Automatic training of speculative models with a single command
- Simple export of trained models to SGLang format
- Support for popular base LLMs and flexible configuration
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram