AIPython★ 1,949⑂ 175 forksMIT
kyegomez/BitNet
BITNET: 1-BIT TRANSFORMER
BitNet implementation: 1-bit transformers for LLM in PyTorch. Open source code for fast experiments.
// KEY FEATURES
- Support for training and inference of 1-bit weights
- Compatibility with HuggingFace Transformers
- Memory savings up to 16x compared to FP16
#artificial-intelligence#deep-neural-networks#deeplearning#gpt4#machine-learning#multimodal#multimodal-deep-learning
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram