AIRust★ 322
lightseekorg/smg
SMG - Universal LLM Gateway
SMG — engine‑agnostic LLM gateway on Rust with full compatibility with OpenAI and Anthropic API.
// KEY FEATURES
- gRPC‑pipeline with low latency and high throughput
- KV‑cache‑aware routing, token caching and chat history
- WASM plugins, multi‑tenant auth and Embeddings API
#anthropic#anthropic-api#chat#claude#gemini#inference-gateway#lightseek#llm#mcp#openai#responses-api#routing
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram