R_REDDYX.XYZ
AIPython★ 227⑂ 42 forksApache-2.0

InferMatrixLab/vllm-rlt

VLLM INFERENCE: LOOPED TRANSFORMERS

vllm-rlt — vLLM-style inference engine for looped transformers. Implements loop-level scheduling and execution via composable stages. 207 stars on GitHub.

// KEY FEATURES

  • Loop-level scheduling for looped transformers
  • Composable stages for flexible execution
  • vLLM-inspired inference architecture
  • Python implementation with 207 GitHub stars
#inference-engine#llm#transformer
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Evolving AI Agent★ 227SEMIA: AI AGENT SECURITY AUDIT★ 227AGHUB FOR ALL AI AGENTS★ 227RESEARCHERSKILL — IDEA FOUNTAIN★ 227KILN: MULTI-MODEL AI ORCHESTRATION★ 227CODEKANBAN: TERMINAL MANAGEMENT★ 227

← FULL CATALOG

InferMatrixLab/vllm-rlt — Vllm Inference: Looped Transformers