AIPython★ 857
datawhalechina/zero-to-sglang
ZERO-TO-SGLANG: LLM INFERENCE TRAINING
The Datawhale and SGLang course teaches LLM inference from scratch: build a mini‑SGLang, study the source code, and land your first PR. Available in English and Chinese.
// KEY FEATURES
- Step‑by‑step explains LLM inference principles and KV‑cache operation.
- Teaches building a mini‑SGLang from scratch using Python and CUDA.
- Reviews real SGLang code: structure, optimizations, API.
- Helps submit your first pull‑request to the open‑source SGLang project.
#cuda#datawhale#inference-engine#infra#kv-cache#llm#llm-inference#sglang#tutorial
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram