R_REDDYX.XYZ
AIC++★ 283⑂ 69 forksApache-2.0

alibaba/tair-kvcache

TAIR-KVCACHE: ACCELERATING LLM INFERENCE

A high-performance KV caching system from Alibaba Cloud that accelerates LLM inference.

// KEY FEATURES

  • Global cache management to reduce latency
  • HiSim inference simulation for testing
  • Written in C++ for maximum performance
#hisim#kv-cache#kvcache#llm#simulator
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

PAXM: Memory for AI Agents★ 283MONET: Claude Management★ 283FINNTS: Financial Forecast in R★ 283PILOT HARNESS: AI Developer Assistant★ 283MNEMORY: MEMORY FOR AI AGENTS★ 283SAFESTCLAW ALTERNATIVE OPENCLAW★ 283

← FULL CATALOG

alibaba/tair-kvcache — Tair-Kvcache: Accelerating LLM…