R_REDDYX.XYZ
AIPython★ 1,394⑂ 181 forksMIT

Zefan-Cai/KVCache-Factory

KVCache-Factory: Cache Compression for LLM

Unified KV-cache compression methods for autoregressive models. Memory savings and faster inference in one package.

// KEY FEATURES

  • Unified approach to KV-cache compression
  • Support for autoregressive models
  • Open-source Python implementation
#kv-cache#kv-cache-compression#llm
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Evolving Skills for AI★ 1395XTREME1 — PLATFORM FOR MULTIMODAL ANNOTATION★ 1393WLLAMA: LLM in Browser, No Server★ 1392PRUNA - ACCELERATING MODELS★ 1391SUGGESTARR: AUTO PICK★ 1391AI Video Production Kit★ 1397

← FULL CATALOG

Zefan-Cai/KVCache-Factory — KVCache-Factory: Cache…