R_REDDYX.XYZ
AIPython★ 2,136⑂ 176 forks

datawhalechina/zero-to-sglang

ZERO-TO-SGLANG: LLM INFERENCE TRAINING

The Datawhale and SGLang course teaches LLM inference from scratch: build a mini‑SGLang, study the source code, and land your first PR. Available in English and Chinese.

// KEY FEATURES

  • Step‑by‑step explains LLM inference principles and KV‑cache operation.
  • Teaches building a mini‑SGLang from scratch using Python and CUDA.
  • Reviews real SGLang code: structure, optimizations, API.
  • Helps submit your first pull‑request to the open‑source SGLang project.
#cuda#datawhale#inference-engine#infra#kv-cache#llm#llm-inference#sglang#tutorial
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

ADR: AI Agent Security in Uber★ 2135JoyAI Video Editor★ 2138OPEN-AGENT-EMAIL: INFRASTRUCTURE FOR AI AGENTS★ 2133Human-in-the-Loop Phone Automation★ 2140FUSIO: INDEPENDENT API MANAGEMENT★ 2131LLM-Space — Prototype Agents Easily★ 2130

← FULL CATALOG

datawhalechina/zero-to-sglang — Zero-TO-Sglang: LLM…