R_REDDYX.XYZ

LLMOps: open-source projects on GitHub

82 repositories on LLMOps, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Openai 690MCP 1602Observability 92RAG 533Langchain 196AI Agents 1319Anthropic 452Prompt Engineering 175Generative AI 192Machine Learning 190LLM Evaluation 45AI Gateway 47Agents 400
kimtth/azure-openai-llm-notes

AZURE OPENAI LLM NOTES - MONTHLY

A curated collection of resources on Azure OpenAI, LLM, RAG, and agents with monthly updates. Ideal for quick start and deep dive.

★ 422 · Python
mezmo/aura

AURA: AUTONOMOUS RUST SRE AGENT

AURA turns an LLM into a reliable autonomous SRE agent: guardrails, API, state management, auth, streaming and tool integrations for production.

★ 413 · Rust
rhesis-ai/rhesis

COLLABORATION LAYER FOR AI AGENTS

Rhesis — platform for testing, simulating, and tracing AI agents. Experts annotate behavior, engineers improve agent based on found issues. Closes feedback loop between t

★ 404 · Python
TensorOpsAI/LLMstudio

LLMstudio - Simple LLM Production

LLMstudio is a framework for fast deployment of LLM applications in production, simplifying deployment and scaling.

★ 391 · Python
microsoft/genaiops-promptflow-template

TEMPLATE GENAIOPS PROMPT FLOW

Template GenAIOps with Prompt Flow simplifies creation of LLM applications through centralized hosting, lifecycle management, and experiments with prompt variants and hyp

★ 370 · Python
starbaser/ccproxy

CCPROXY Mods for Claude Code

ccproxy allows intercepting any requests to Claude Code and modifying responses, as well as connecting your own models via /model.

★ 360 · Python
heaven999b/hello-agent-system

Enterprise AI Agent Design Course

17 bilingual lessons teaching enterprise AI agent system design with hands-on exercises covering tools, RAG, security, evals, and distributed execution.

★ 316 · Python
runtm-ai/runtm

RUNTM: ISOLATED SANDBOXES

Open sandbox for AI agents: isolated environments where Claude Code and Cursor write and deploy code.

★ 306 · Python
qiantongtech/qKnow

QKNOW: AI Agent for Business

Open platform for AI agents: knowledge graph, RAG, and ready-made bots. Fast integration of data and documents.

★ 298 · Java
Yigtwxx/awesome-rag-production

AWESOME RAG PRODUCTION

List of proven tools and practices for building scalable RAG systems in Python.

★ 295 · Python
ferro-labs/ai-gateway

AI-GATEWAY: Unified LLM Gateway

Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.

★ 291 · Go
Keesan12/martin-loop

MARTIN LOOP: AUTONOMOUS CODE AGENTS

Launch AI agents to write code without constant supervision. Martin Loop keeps tasks within strict boundaries, checks them and provides accountability from start to finis

★ 286 · TypeScript
fkiene/llmtrim

LLMTRIM: LLM Request Compression

A local proxy that cuts tokens in LLM requests without altering responses, saving up to 31% of input and 74% of output tokens.

★ 274 · Rust
w8123/EnterpriseAgentFramework

ENTERPRISE AI AGENT

Platform for registering business APIs as AI capabilities in Java/Spring Boot: creating agents via GraphSpec, MCP/A2A/Gateway and monitoring execution.

★ 273 · Java
InftyAI/Awesome-LLMOps

BEST LLM OPS LIST

A selection of the most useful tools for LLMOps: from experiments to production.

★ 272 · Python
yanstd888/9routerx

AI Router & Token-Saving Gateway

Single-binary Go router directing Claude Code, Cursor, and Codex across 155 providers with 20-40% token savings.

★ 244 · Go
OpenMachine-ai/transformer-tricks

TRANSFORMER-TRICKS - ACCELERATING TRANSFORMERS

A collection of techniques and utilities for accelerating transformers: attention optimization, quantization, and caching of computations.

★ 236 · TeX
traceloop/hub

HUB: RUST LLM GATEWAY

High-scale LLM gateway in Rust with built-in observability via OpenTelemetry. Easily scalable and production-ready.

★ 233 · Rust
GetBusbar/busbar

BUSBAR: MANAGING AI AGENTS

busbar is the execution control plane for AI agents, controlling each model request, MCP tool call, A2A delegation, and subsequent action while preserving all native LLM

★ 222 · Rust
api7/aisix

OPEN SOURCE AI GATEWAY IN RUST

aisix — a single OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock. Supports routing, guardrails, caching, rate limits, and observability. 201 stars on GitHub.

★ 220 · Rust
Rodiun/frugon

FRUGON - LLM COST ANALYSIS

Free, local, and open LLM cost analyzer. See where your spend “leaks,” right on your machine.

★ 218 · Python
wanmol/goal-flow

Goal-Flow Graph Agent

Goal-Flow is a LangGraph framework that combines workflow graphs and agent loops, translating Dify DSL into executable code and switching Dify/OpenAI protocols.

★ 137 · Python

New projects on this topic in Telegram

Telegram →
LLMOps — page 2 | REDDYX AI