R_REDDYX.XYZ
AIPython★ 268⑂ 70 forksMIT

lightseekorg/TorchSpec

TORCHSPEC SPECULATIVE DECODING

PyTorch library for training speculative decoding models, accelerating text generation.

// KEY FEATURES

  • Native PyTorch integration for easy use
  • Support for various speculative decoding architectures
  • Automatic generation acceleration without quality loss
#eagle3#fsdp#lightseek#llm#mooncake#pytorch#sglang#tokenspeed#vllm
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

LINEARIS CLI FOR LINEAR.APP★ 268LLAMA_ROS ROS 2 LLM★ 268GRACE: AI CODE WITH KNOWLEDGE GRAPHS★ 268MULTITERMINAL FOR AGENTS★ 268OPTIMIZING PROMPTS FOR SEEDANCE 2.5★ 268BKMR SMART KNOWLEDGE MANAGER★ 268

← FULL CATALOG

lightseekorg/TorchSpec — Torchspec Speculative Decoding