AIC++★ 254⑂ 17 forksApache-2.0
huawei-csl/MACaQ
Model-Agnostic Quantization Framework
Quantize and run text, image, video, and audio models across GGUF, llama.cpp, vLLM, Diffusers, and PyTorch with state-of-the-art model-agnostic quantization.
// KEY FEATURES
- Quantizes text, image, video, audio models to GGUF format
- Supports llama.cpp, vLLM, Diffusers, PyTorch inference
- Implements SOTA model-agnostic quantization algorithms
#ascend#audio#audio-generation#diffusers#gguf#gguf-quantization#image-generation#llama-cpp#llm#local-ai#local-inference#quantization
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram