R_REDDYX.XYZ
AIPython★ 8,246

bitsandbytes-foundation/bitsandbytes

BITSANDBYTES: LLM COMPRESSION

Library for k-bit quantization of large language models, enabling LLM execution on regular hardware via PyTorch.

// KEY FEATURES

  • 4-bit quantization without quality loss
  • Support for PyTorch and HuggingFace Transformers
  • Automatic precision mixing for faster inference
#llm#machine-learning#pytorch#qlora#quantization
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

MobileGestalt Editor for iOS★ 8248VIBE CODE WITH PI IN IDE★ 8259MLX-AUDIO: SPEECH ON APPLE SILICON★ 8267GPTCache: SEMANTIC CACHE FOR LLM★ 8224Claude Code Tips★ 8210GITHUB COPILOT IN XCODE NATIVELY★ 8204

← FULL CATALOG

bitsandbytes-foundation/bitsandbytes — Bitsandbytes: LLM…