AIPython★ 219⑂ 32 forksMIT
etalab-ia/OpenGateLLM
OPEN GATE FOR LLM
OpenGateLLM — open-source unified interface for running and managing self-hosted LLMs. It lets you easily connect the models via the API and control their operations in one place.
// KEY FEATURES
- Launches any self-hosted LLMs via a unified API gateway.
- Provides a web panel for monitoring usage, performance of self hosted deployed models.
- Supports integration with the popular frameworks:the Hugging Face, Ollama, vLLM.
- Simplifies deployment via Docker‑compose and Kubernetes with the configs.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram