R_REDDYX.XYZ
AIRust★ 322

lightseekorg/smg

SMG - Universal LLM Gateway

SMG — engine‑agnostic LLM gateway on Rust with full compatibility with OpenAI and Anthropic API.

// KEY FEATURES

  • gRPC‑pipeline with low latency and high throughput
  • KV‑cache‑aware routing, token caching and chat history
  • WASM plugins, multi‑tenant auth and Embeddings API
#anthropic#anthropic-api#chat#claude#gemini#inference-gateway#lightseek#llm#mcp#openai#responses-api#routing
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

🤖 BOX AI Assistant★ 3222000+ APIs for AI Agents★ 322TYPE TEXT BY VOICE X!★ 322AI ASSISTANT FOR GODOT★ 322NO_HUMAN: FULL AUTONOMOUS AI AGENT★ 322BAMBU PRINTER MCP SERVER★ 322

← FULL CATALOG

lightseekorg/smg — SMG - Universal LLM Gateway | REDDYX AI