AIPython★ 904⑂ 75 forksApache-2.0
mosecorg/mosec
MOSEC - MAXIMUM ML PRODUCTIVITY
Fast framework for serving ML models with dynamic batching and CPU/GPU pipelines.
// KEY FEATURES
- Dynamic batching to increase throughput
- Simultaneous CPU and GPU pipeline support
- Easy integration with any Python model
#cv#deep-learning#gpu#hacktoberfest#jax#llm#llm-serving#machine-learning#machine-learning-platform#mlops#model-serving#mxnet
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram