R_REDDYX.XYZ
AI★ 2,469⑂ 246 forks

AI-Efficiency/Awesome-Model-Quantization

AWESOME MODEL QUANTIZATION RESOURCES

A curated list of articles, benchmarks, surveys, and tools for neural network quantization. Covers low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization. Supports efficient model deployment.

// KEY FEATURES

  • Indexes over 200 articles and surveys on model quantization with tags and search.
  • Includes ready-made benchmarks and scripts for evaluating accuracy and speed of low-bit networks.
  • Provides links to libraries and tools for quantizing LLMs, multimodal and generative models.
  • Covers vector and lattice quantization, data-free quantization methods, and deployment recommendations.
#awesome#awesome-list#awesome-lists#binarization#binary-neural-networks#data-free-quantization#diffusion-models#efficient-inference#kv-cache#kv-cache-quantization#large-language-models#large-language-models-llms
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

NATIVE LLM SERVER FOR MAC★ 2472Medical AI Skills Library★ 2473WHISPERJAV NOISE-FREE SUBTITLES★ 2465BETTER HARNES - MANAGE CODE SCIENTIFICALLY★ 2462Conduit – Mobile AI Window★ 2461Story to Handdrawn Video★ 2481

← FULL CATALOG

AI-Efficiency/Awesome-Model-Quantization — Awesome Model…