R_REDDYX.XYZ
AIGo★ 213⑂ 48 forksApache-2.0

inference-gateway/inference-gateway

INFERENCE GATEWAY: UNIFIED LLM

Cloud gateway that unifies local and cloud LLM providers: Ollama, OpenAI, Groq and others, built in Go.

// KEY FEATURES

  • Support for Ollama, OpenAI, Groq, Cohere and others
  • High performance and cloud-native architecture
  • Unified API for accessing different LLM providers
#agnostic#anthropic#api#cohere#deepseek-v4-pro#gateway#gateway-api#golang#inference-api#kubernetes#llm#openai
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Ultrasonic drone detector★ 213ZOO CLAUDE CODE STATUSLINE★ 213TAOS Self-Learning AI OS★ 213CONTROL AI CODER FROM PHONE★ 213AMAZON-BEDROCK-RAG - SMART RAG★ 213GRACE: INT4 QWEN3-VL DISTILL★ 213

← FULL CATALOG

inference-gateway/inference-gateway — Inference Gateway:…