R_REDDYX.XYZ

MLOps: open-source projects on GitHub

47 repositories on MLOps, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Machine Learning 190Deep Learning 105LLMOps 82AI Agents 1319Pytorch 98Generative AI 192RAG 533Agents 400ML 32Artificial Intelligence 157Kubernetes 80MCP 1601Model Serving 18
qdrant/qdrant

VECTOR DATABASE AND SEARCH ENGINE

Qdrant is a vector database and semantic search engine written in Rust. Stores vectors with payload, supports filtering, and works in both client-server and embedded mode

★ 35,599 · Rust
mlflow/mlflow

MLflow — AI Platform

Open platform for AI engineering. Allows teams to debug, evaluate, and optimize AI applications while managing access and costs.

★ 26,029 · Python
NirDiamant/agents-towards-production

FROM PROTOTYPE TO ENTERPRISE

Complete step-by-step tutorials for building GenAI agents for production — from prototype to enterprise deployment.

★ 20,541 · Jupyter Notebook
stas00/ml-engineering

ML-ENGINEERING OPEN BOOK

Open book on ML engineering with practical materials and examples in Python.

★ 19,717 · Python
microsoft/agent-lightning

AGENT-LIGHTNING - TRAIN AI AGENTS

Platform for fast training and deployment of AI agents in Python. Enables faster creation of intelligent assistants.

★ 18,957 · Python
bentoml/OpenLLM

OPENLLM: RUN LLMS AS OPENAI API

OpenLLM allows running any open-source LLMs (Llama, Qwen, DeepSeek) as OpenAI-compatible APIs with a single command. Includes chat UI, modern inference backends, and read

★ 12,607 · Python
tensorzero/tensorzero

TensorZero: LLMOps Platform

An open LLMOps platform that unifies LLM gateway, observability, evaluation, optimization, and experiments.

★ 11,366 · Rust
Netflix/metaflow

METAFLOW — ML MANAGEMENT

Metaflow simplifies building, managing, and deploying AI/ML systems on Python, allowing focus on data science.

★ 10,114 · Python
bentoml/BentoML

BENTOML PATH TO AI API

Serve models and AI applications in minutes: API, queues, multi‑model pipelines, and LLM services.

★ 8,663 · Python
flyteorg/flyte

FLYTE: AI Workflow Orchestration

Flyte is a dynamic and resilient platform for AI orchestration, enabling easy unification of data, models, and compute resources into cohesive workflows.

★ 7,059 · Go
zenml-io/zenml

ZENML: AI PLATFORM FROM PIPELINE

ZenML is a Python framework for creating AI pipelines and agents, unifying data, models, and orchestration in a single platform.

★ 5,636 · Python
Giskard-AI/giskard-oss

GISKARD-OSS - LLM AGENT EVALUATION

Library for evaluating and testing LLM agents with open-source code.

★ 5,417 · Python
argilla-io/argilla

ARGILLA - CREATE DATASETS FASTER

Argilla helps AI engineers and domain experts collaboratively create high-quality datasets for training models.

★ 5,203 · Python
mahseema/awesome-ai-tools

List of Top AI Tools

A collection of the best tools for working with artificial intelligence: frameworks, libraries, and services.

★ 5,193
FedML-AI/FedML

Universal FedML Platform

A universal library for distributed training, model serving, and federated learning with a cross-cloud scheduler.

★ 4,046 · Python
TarrySingh/Artificial-Intelligence-Deep-Learning-Machine-Learning-Tutorials

SYNAPSA COMMONS: FREE AI COURSES

Free practical AI courses in Colab, Kaggle, Binder, Codespaces and Jupyter. They include evidence of EU AI Act compliance, model validation, document extraction, search a

★ 4,026 · Python
SwanHubX/SwanLab

SWANLAB: TRACKING AND VISUALIZATION

SwanLab is an open-source tool for tracking and visualizing AI model training, compatible with PyTorch, Transformers, and other frameworks.

★ 3,981 · Python
hemansnation/AI-Engineer-Headquarters

AI‑ENGINEER HQ: SCIENCE CORE

The project contains Jupyter notebooks with methods for training models, RAG pipelines on LangChain and data structure algorithms for AI agents. It allows quickly creatin

★ 3,780 · Jupyter Notebook
alvinreal/awesome-opensource-ai

Open AI Catalog

A list of the best truly open-source AI projects, models, tools, and infrastructure. Helps developers find high-quality open-source resources.

★ 3,559 · Python
datachain-ai/datachain

DATACHAIN - DATA WITH AI

Typed versioned datasets for unstructured data on top of S3, GCS, and Azure. A great tool for working with AI information.

★ 2,748 · Python
apache/hamilton

HAMILTON - MODULAR DATAFLOW

Apache Hamilton simplifies creating testable, self-documenting data pipelines with lineage tracking.

★ 2,512 · Jupyter Notebook
kubeflow/trainer

Trainer: Distributed Training

The trainer project enables distributed training of AI models and fine‑tuning of LLMs in Kubernetes, written in Go.

★ 2,284 · Go
vllm-project/vllm-ascend

VLLM-ASCEND: ASCEND PLUGIN ON GITHUB

Community plugin for vLLM on Ascend hardware from the community, written in C++. Gaining stars — already 2156!

★ 2,156 · C++
superlinked/sie

SUPERLINKED INFERENCE ENGINE

Open-source server for embedding inference, reranking, and data extraction. 2000+ stars on GitHub.

★ 2,029 · Python
kubeflow/katib

KATIB DEPRECATED: MIGRATE TO TRAINER

Project Katib is deprecated. Migrate to OptimizationJob and Kubeflow Trainer for hyperparameter tuning.

★ 1,708 · Python
pixeltable/pixeltable

PIXELTABLE — DECLARATIVE AI BACKEND

Pixeltable is a declarative, incremental backend for multimodal AI applications, simplifying work with data and models.

★ 1,569 · Python
psalias2006/gpu-hot

🔥 GPU REAL‑TIME DASHBOARD

GPU-hot — a web dashboard for monitoring NVIDIA GPU showing temperature, load, and memory in real time. Already over 1,500 stars on GitHub! 🌟

★ 1,543 · JavaScript
patchy631/time-to-first-token

LLM Inference Optimization Roadmap

A 10‑week plan to study the service and accelerate large language models, covering vLLM, SGLang, quantization, and speculative decoding practices.

★ 1,179 · HTML
Xiangyue-Zhang/auto-deep-researcher-24x7

AI Agent 24/7

An autonomous AI agent runs your deep experiments 24/7, saving resources and memory. The Leader‑Worker architecture ensures stable operation at zero cost.

★ 1,035 · Python
AgileRL/AgileRL

AgileRL - Evolutionary Acceleration

AgileRL speeds up RL training 10× via evolutionary hyperparameter optimization and ready-to-use SOTA algorithms.

★ 967 · Python
mosecorg/mosec

MOSEC - MAXIMUM ML PRODUCTIVITY

Fast framework for serving ML models with dynamic batching and CPU/GPU pipelines.

★ 904 · Python
kossisoroyce/timber

ML Models Compiler to C99

An AOT compiler that converts XGBoost, LightGBM, scikit-learn, CatBoost, and ONNX models into native C99 code, achieving inference speedups of up to 336× compared to Pyth

★ 680 · Python
superlinked/VectorHub

VECTORHUB - DEPRECATED REPOSITORY FOR EMBEDDINGS

The archived VectorHub project showcases early work on vector search. The team is now focused on SIE — a self-hosted engine for embeddings, ranking, and document processi

★ 535 · Jupyter Notebook
RiccardoBiosas/awesome-MLSecOps

Awesome MLSecOps Resources

A curated collection of tools, articles, and resources on machine learning security and MLOps.

★ 492
caipe-io/ai-platform-engineering

PLATFORM FOR AI AGENTS

The open CAIPE platform helps create, deploy, and manage AI agents and their workflows on TypeScript.

★ 444 · TypeScript
microsoft/genaiops-promptflow-template

TEMPLATE GENAIOPS PROMPT FLOW

Template GenAIOps with Prompt Flow simplifies creation of LLM applications through centralized hosting, lifecycle management, and experiments with prompt variants and hyp

★ 370 · Python
matrixhub-ai/matrixhub

MATRIXHUB: AI Hub – Open Source

Self-hosted platform for AI models with Hugging Face compatibility and vLLM/SGLang acceleration. Stars: 246 ⭐

★ 367 · Go
zenml-io/kitaru

KITARU: AI AGENTS IN PRODUCTION

kitaru lets you record, replay, and improve AI agents in production on ZenML. Debugging and optimization become simpler and faster.

★ 319 · Python
zorost/AI-Engineering-Lab

AI Engineering Lab Course

Free self-study 24-week AI engineering course: Python, machine learning, LLMs, RAG, fine-tuning, agents, and work with Azure, Vertex, Bedrock, and Databricks. 43 interact

★ 318 · Jupyter Notebook
vortico/flama

FLAMA: ONE LINE FOR AI API

Framework for fast deployment of AI models as API with built-in chat and MCP support.

★ 307 · Python
hongbo-miao/hongbomiao.com

TITLE - HONGBOMIAO LAB

Personal R&D laboratory on Python with 298 stars, uniting developers to share knowledge and grow together.

★ 300 · Python
Yigtwxx/awesome-rag-production

AWESOME RAG PRODUCTION

List of proven tools and practices for building scalable RAG systems in Python.

★ 295 · Python
Future-Proof-DS/interactive-ai-ml-tools

Interactive MLOps Learning Tools

Free interactive tools for learning MLOps, ML system design, and agentic analytics with simulators and system maps.

★ 267
healthchainai/HealthChain

HEALTHCHAIN: AI FOR MEDICAL DATA

Python SDK that connects AI models to real‑world EHR systems, eliminating complex integration.

★ 231 · Python
deepset-ai/haystack-core-integrations

haystack-core-integrations - SCALE HAYSTACK FAST

Additional packages for Haystack: components, document stores, and other tools extending its capabilities.

★ 212 · Python
jsdhwfmax/EvalForge

EVALFORGE — LLM EVALUATION IN CI

EvalForge is a tool for LLM evaluation in CI/CD. Provides evaluator-neutral evidence, baseline regression gates, and JSON, JUnit, SARIF reports. Integrates with GitHub Ac

★ 194 · Python
BlueRingsLabs/no-shortcuts

Comprehensive AI Engineering Course

Free 173-lesson course covering data, ML, deep learning, and AI engineering with 166 runnable labs. Covers math, code, systems, and security under CC BY-NC 4.0.

★ 175 · Python

New projects on this topic in Telegram

Telegram →
MLOps — 47 open-source GitHub projects | REDDYX AI