R_REDDYX.XYZ
AIPython★ 90⑂ 4 forksApache-2.0

datologyai/zephon

Elastic Data Loading

Zephon offers fast, flexible, elastically deterministic data loading for foundation‑model training, ensuring reproducible sampling and high throughput.

// KEY FEATURES

  • Provides elastic, deterministic shuffling for reproducible ordering across epochs.
  • Integrates with PyTorch DataLoader, supporting custom samplers and collate functions.
  • Scales to large‑scale foundation model training with low overhead and high throughput.
#data-loader#deep-learning#distributed-training#pytorch
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Cross-sector AML compliance framework★ 90AI Agent Platform★ 90Offline Tourist Safety★ 89Ruach Studio Music Workbench★ 91AI Web Answer Crawler★ 89Pi Documentation Navigator★ 88

← FULL CATALOG

datologyai/zephon — Elastic Data Loading | REDDYX AI