R_REDDYX.XYZ
AIGo★ 427⑂ 44 forksMIT

messkan/prompt-cache

PROMPT CACHE SAVINGS 80%

Intelligent semantic cache for LLM prompts, reduces costs up to 80% and delivers sub‑millisecond responses. Provider‑agnostic Go proxy.

// KEY FEATURES

  • Semantic prompt caching
  • Reducing LLM costs by up to 80%
  • Response latency under 1 ms, provider‑agnostic
#ai#badgerdb#cache#claude#cost-optimization#go#langchain#llm#middleware#mistral#openai#performance
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Context Layer for AI Agents★ 427GITHUB AGENTS: LIVE DOCS★ 427OLYMPUS UNIFIES CV TASKS★ 427BACKTEST STOCKS WITH CLAUDE CODE★ 427IDE FILE TREE FOR CLAUDE CODE★ 427GETCITO: FIRST OPEN SOURCE AIO/GEO★ 427

← FULL CATALOG

messkan/prompt-cache — Prompt Cache Savings 80% | REDDYX AI