AIPython★ 60
MatthewK78/Rose
Rose — PyTorch Optimizer
Stateless PyTorch optimizer that normalizes gradients for stable and balanced model training.
// KEY FEATURES
- Normalizes gradient updates
- Improves training stability
- Simple PyTorch integration
- GPU support and autoscaling
#adam-optimizer#ai#artificial-intelligence#deep-learning#diffusion-models#fine-tuning#gpt#gradient-descent#large-language-models#llm#lora#machine-learning
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram