AIPython★ 451⑂ 30 forksApache-2.0
luyug/GradCache
GradCache: Gradient Caching
A library for efficient large-batch training in contrastive learning, overcoming GPU/TPU memory limitations through gradient caching.
// KEY FEATURES
- Large-batch training with limited memory
- Contrastive learning support (SimCLR, MoCo, etc.)
- PyTorch integration and distributed training compatibility
#contrastive-learning#deep-learning#embedding#flax#jax#large-language-models#pytorch#vector-database
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram