AIRust★ 300⑂ 20 forksMIT
ghuntley/underclass
UNDERCLASS PROXY OPENAI
underclass — OpenAI‑compatible proxy that pins sessions to one account, keeping the prompt cache warm. When a subscription’s quota is exhausted, it cools it down until the window resets, and when the pool is fully exhausted it returns the earliest Retry‑After.
// KEY FEATURES
- The proxy pins sessions to one account, keeping the prompt cache warm.
- When a subscription’s quota is exhausted, it puts it on hold until the limit resets.
- When the pool is fully exhausted, it returns the earliest Retry‑After from response headers.
- OpenAI‑compatible API: accepts requests in the same format and load‑balances across accounts.
#openai#openai-proxy-load-balancer
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram