AIPython★ 604
Continuum-AI-Corp/OrcaRouter-Lite
ORCALITE LLM ROUTER SELF-HOSTED
Self-hosted LLM router with managed safety net and OpenAI‑compatible API. Supports BYOK, a single workspace, and streaming generation. For advanced routing use the hosted OrcaRouter.
// KEY FEATURES
- OpenAI‑compatible endpoint with chat/completions and embeddings support.
- BYOK: plug in your own keys for Anthropic, OpenAI, Cohere and other providers.
- Single workspace with token management and safety limits.
- Streaming generation and automatic fallback on errors.
#ai-gateway#ai-gateway-client#ai-gateways#anthropic-api#byok#fastapi#gemini-api#litellm#llm-router#llm-router-server#new-api#new-api-pro
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram