AIGo★ 427⑂ 44 forksMIT
messkan/prompt-cache
PROMPT CACHE SAVINGS 80%
Intelligent semantic cache for LLM prompts, reduces costs up to 80% and delivers sub‑millisecond responses. Provider‑agnostic Go proxy.
// KEY FEATURES
- Semantic prompt caching
- Reducing LLM costs by up to 80%
- Response latency under 1 ms, provider‑agnostic
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram