R_REDDYX.XYZ
AIC++★ 5,429

kvcache-ai/Mooncake

MOONCAKE - KIMI LLM PLATFORM, 5400+ STARS

Mooncake is the backend platform for Kimi from Moonshot AI. High-performance open-source LLM service in C++.

// KEY FEATURES

  • LLM serving platform for Kimi from Moonshot AI
  • Written in C++ for high performance
  • Over 5,400 stars on GitHub
#disaggregation#inference#kvcache#llm#rdma#sglang#vllm
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Skillhub - Skill Registry★ 5428LM STUDIO CLI: MANAGE MODELS★ 5430DESKCOMMCRM — OPEN AI CRM★ 5419FrontierAgent framework★ 5439GISKARD-OSS - LLM AGENT EVALUATION★ 5417Bindu Live Microservice★ 5446

← FULL CATALOG

kvcache-ai/Mooncake — Mooncake - Kimi LLM Platform, 5400+…