R_REDDYX.XYZ
AIPython★ 219⑂ 32 forksMIT

etalab-ia/OpenGateLLM

OPEN GATE FOR LLM

OpenGateLLM — open-source unified interface for running and managing self-hosted LLMs. It lets you easily connect the models via the API and control their operations in one place.

// KEY FEATURES

  • Launches any self-hosted LLMs via a unified API gateway.
  • Provides a web panel for monitoring usage, performance of self hosted deployed models.
  • Supports integration with the popular frameworks:the Hugging Face, Ollama, vLLM.
  • Simplifies deployment via Docker‑compose and Kubernetes with the configs.
#api#llm#self-hosted
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

MORLOC: FUNCTIONAL TYPED LANGUAGE★ 219SUNPEAK MCP FRAMEWORK FOR AI★ 219ETOS-LLM-STUDIO:AI ASSISTANT ON iOS★ 219DSH INDUSTRY RESEARCH PACK★ 219REDUCING TOKENS WITHOUT LIMITS★ 219EMBODY: FULL MCP TOOLKIT FOR TOUCHDESIGNER★ 219

← FULL CATALOG

etalab-ia/OpenGateLLM — Open Gate For LLM | REDDYX AI