R_REDDYX.XYZ
AIPython★ 214⑂ 111 forksApache-2.0

mindspore-ai/hyper-parallel

LLM TRAINING ACCELERATION ON SUPERPOD

Framework for distributed LLM training with SuperPod topology awareness. Optimizes process placement and inter-GPU communication. Supports PyTorch and scales to thousands of accelerators.

// KEY FEATURES

  • Accounts for SuperPod topology for process affinity
  • Minimizes inter-GPU communication during all-reduce
  • Integrates with PyTorch Distributed without code changes
  • Scales LLM training to thousands of H100 GPUs
#ai-infrastructure#distributed-training#llm#omni#pytorch
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

SHOB – AI Agent for Code★ 214MEMEX: LOCAL AI JOURNAL★ 214LEARNING TO BUILD AI AGENTS★ 214CLAUDE BECAME DESIGN ARCHITECT★ 214SELF-HOSTED AI PLATFORM★ 214GUARDIANDB RUST DECENTRALIZED DB★ 214

← FULL CATALOG

mindspore-ai/hyper-parallel — LLM Training Acceleration ON…