AIPython★ 1,221⑂ 317 forksApache-2.0
openvinotoolkit/nncf
NNCFF - ACCELERATING MODEL INFERENCE
NNCFF is a neural network compression framework for accelerated inference in OpenVINO™. It reduces model size while preserving accuracy.
// KEY FEATURES
- Support for quantization and pruning
- Integration with OpenVINO™ for accelerated CPU/GPU inference
- Automatic search for optimal compression parameters
#bert#classification#compression#deep-learning#genai#llm#mixed-precision-training#nlp#object-detection#onnx#openvino#pruning
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram