AI★ 2,438
AI-Efficiency/Awesome-Model-Quantization
AWESOME MODEL QUANTIZATION RESOURCES
A curated list of articles, benchmarks, surveys, and tools for neural network quantization. Covers low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization. Supports efficient model deployment.
// KEY FEATURES
- Indexes over 200 articles and surveys on model quantization with tags and search.
- Includes ready-made benchmarks and scripts for evaluating accuracy and speed of low-bit networks.
- Provides links to libraries and tools for quantizing LLMs, multimodal and generative models.
- Covers vector and lattice quantization, data-free quantization methods, and deployment recommendations.
#awesome#awesome-list#awesome-lists#binarization#binary-neural-networks#data-free-quantization#diffusion-models#efficient-inference#kv-cache#kv-cache-quantization#large-language-models#large-language-models-llms
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram