AIGo★ 213⑂ 48 forksApache-2.0
inference-gateway/inference-gateway
INFERENCE GATEWAY: UNIFIED LLM
Cloud gateway that unifies local and cloud LLM providers: Ollama, OpenAI, Groq and others, built in Go.
// KEY FEATURES
- Support for Ollama, OpenAI, Groq, Cohere and others
- High performance and cloud-native architecture
- Unified API for accessing different LLM providers
#agnostic#anthropic#api#cohere#deepseek-v4-pro#gateway#gateway-api#golang#inference-api#kubernetes#llm#openai
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram