R_REDDYX.XYZ
AIPython★ 904⑂ 75 forksApache-2.0

mosecorg/mosec

MOSEC - MAXIMUM ML PRODUCTIVITY

Fast framework for serving ML models with dynamic batching and CPU/GPU pipelines.

// KEY FEATURES

  • Dynamic batching to increase throughput
  • Simultaneous CPU and GPU pipeline support
  • Easy integration with any Python model
#cv#deep-learning#gpu#hacktoberfest#jax#llm#llm-serving#machine-learning#machine-learning-platform#mlops#model-serving#mxnet
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

KAI REVOLUTION IN POCKET★ 904MASTER-FETCH: CLOUDFLARE BYPASS★ 904FIM AI One★ 903Coderunner Local Sandbox for AI★ 903ROME - Agent OS Future★ 902Lightweight SSD Inference Engine★ 907

← FULL CATALOG

mosecorg/mosec — Mosec - Maximum ML Productivity | REDDYX AI