R_REDDYX.XYZ
AIPython★ 26,027⑂ 3,195 forksApache-2.0

deepseek-ai/DeepInfer

High-Performance DeepSeek Inference

DeepInfer accelerates DeepSeek models with optimized kernels, distributed parallelism, and low-latency serving for large-scale deployment.

// KEY FEATURES

  • Optimizes DeepSeek models with custom CUDA kernels for faster inference
  • Enables tensor and pipeline parallelism across multiple GPUs and nodes
  • Provides dynamic batching and KV caching for low-latency serving
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

MLflow — AI Platform★ 26029STAGEHAND SDK FOR BROWSER WEB AGENTS★ 26054CLI for Google Workspace★ 26101SKILLSPECTOR: AGENT PROTECTION★ 26146Knowledge Graph for AI★ 26296Framework for Multi-Agent Systems★ 26338

← FULL CATALOG

deepseek-ai/DeepInfer — High-Performance DeepSeek Inference