LLMOps: open-source projects on GitHub
82 repositories on LLMOps, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
AZURE OPENAI LLM NOTES - MONTHLY
A curated collection of resources on Azure OpenAI, LLM, RAG, and agents with monthly updates. Ideal for quick start and deep dive.
★ 422 · PythonAURA: AUTONOMOUS RUST SRE AGENT
AURA turns an LLM into a reliable autonomous SRE agent: guardrails, API, state management, auth, streaming and tool integrations for production.
★ 413 · RustCOLLABORATION LAYER FOR AI AGENTS
Rhesis — platform for testing, simulating, and tracing AI agents. Experts annotate behavior, engineers improve agent based on found issues. Closes feedback loop between t
★ 404 · PythonLLMstudio - Simple LLM Production
LLMstudio is a framework for fast deployment of LLM applications in production, simplifying deployment and scaling.
★ 391 · PythonTEMPLATE GENAIOPS PROMPT FLOW
Template GenAIOps with Prompt Flow simplifies creation of LLM applications through centralized hosting, lifecycle management, and experiments with prompt variants and hyp
★ 370 · PythonCCPROXY Mods for Claude Code
ccproxy allows intercepting any requests to Claude Code and modifying responses, as well as connecting your own models via /model.
★ 360 · PythonEnterprise AI Agent Design Course
17 bilingual lessons teaching enterprise AI agent system design with hands-on exercises covering tools, RAG, security, evals, and distributed execution.
★ 316 · PythonRUNTM: ISOLATED SANDBOXES
Open sandbox for AI agents: isolated environments where Claude Code and Cursor write and deploy code.
★ 306 · PythonQKNOW: AI Agent for Business
Open platform for AI agents: knowledge graph, RAG, and ready-made bots. Fast integration of data and documents.
★ 298 · JavaAWESOME RAG PRODUCTION
List of proven tools and practices for building scalable RAG systems in Python.
★ 295 · PythonAI-GATEWAY: Unified LLM Gateway
Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.
★ 291 · GoMARTIN LOOP: AUTONOMOUS CODE AGENTS
Launch AI agents to write code without constant supervision. Martin Loop keeps tasks within strict boundaries, checks them and provides accountability from start to finis
★ 286 · TypeScriptLLMTRIM: LLM Request Compression
A local proxy that cuts tokens in LLM requests without altering responses, saving up to 31% of input and 74% of output tokens.
★ 274 · RustENTERPRISE AI AGENT
Platform for registering business APIs as AI capabilities in Java/Spring Boot: creating agents via GraphSpec, MCP/A2A/Gateway and monitoring execution.
★ 273 · JavaBEST LLM OPS LIST
A selection of the most useful tools for LLMOps: from experiments to production.
★ 272 · PythonAI Router & Token-Saving Gateway
Single-binary Go router directing Claude Code, Cursor, and Codex across 155 providers with 20-40% token savings.
★ 244 · GoTRANSFORMER-TRICKS - ACCELERATING TRANSFORMERS
A collection of techniques and utilities for accelerating transformers: attention optimization, quantization, and caching of computations.
★ 236 · TeXHUB: RUST LLM GATEWAY
High-scale LLM gateway in Rust with built-in observability via OpenTelemetry. Easily scalable and production-ready.
★ 233 · RustBUSBAR: MANAGING AI AGENTS
busbar is the execution control plane for AI agents, controlling each model request, MCP tool call, A2A delegation, and subsequent action while preserving all native LLM
★ 222 · RustOPEN SOURCE AI GATEWAY IN RUST
aisix — a single OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock. Supports routing, guardrails, caching, rate limits, and observability. 201 stars on GitHub.
★ 220 · RustFRUGON - LLM COST ANALYSIS
Free, local, and open LLM cost analyzer. See where your spend “leaks,” right on your machine.
★ 218 · PythonGoal-Flow Graph Agent
Goal-Flow is a LangGraph framework that combines workflow graphs and agent loops, translating Dify DSL into executable code and switching Dify/OpenAI protocols.
★ 137 · PythonNew projects on this topic in Telegram
Telegram →