AIPython★ 227⑂ 42 forksApache-2.0
InferMatrixLab/vllm-rlt
VLLM INFERENCE: LOOPED TRANSFORMERS
vllm-rlt — vLLM-style inference engine for looped transformers. Implements loop-level scheduling and execution via composable stages. 207 stars on GitHub.
// KEY FEATURES
- Loop-level scheduling for looped transformers
- Composable stages for flexible execution
- vLLM-inspired inference architecture
- Python implementation with 207 GitHub stars
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram