R_REDDYX.XYZ
AIJupyter Notebook★ 5,831⑂ 947 forksApache-2.0

rasbt/reasoning-from-scratch

LLM FROM SCRATCH IN PYTORCH

The reasoning-from-scratch project shows how to build a Reasoning LLM from scratch in PyTorch, step by step. Implemented in Jupyter notebooks: architecture, training with CoT and distillation, plus experiments with GRPO.

// KEY FEATURES

  • Step-by-step transformer architecture and LLM training from scratch in PyTorch
  • Integration of chain-of-thought (CoT) technique to improve model reasoning
  • Application of distillation and GRPO methods to improve answer quality with less resources
  • Everything done in Jupyter notebooks with visualization of training steps and inference
#ai#artificial-intelligence#chain-of-thought#deep-learning#distillation#grpo#inference-time-scaling#large-language-models#llm#llms#machine-learning#math-reasoning
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

PHP CLIENT FOR OPENAI★ 5835RUOYI-AI AI Agent Framework★ 5837RUN VLM LOCALLY ON MAC★ 5847AI-POWERED VIRTUAL EXECUTIVE TEAM★ 5812Session Recording and Skill Creation★ 5809COST-XRAY: SEE CLAUDE CODE COSTS★ 5806

← FULL CATALOG

rasbt/reasoning-from-scratch — LLM From Scratch IN Pytorch