MLOps: open-source projects on GitHub
47 repositories on MLOps, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
VECTOR DATABASE AND SEARCH ENGINE
Qdrant is a vector database and semantic search engine written in Rust. Stores vectors with payload, supports filtering, and works in both client-server and embedded mode
★ 35,599 · RustMLflow — AI Platform
Open platform for AI engineering. Allows teams to debug, evaluate, and optimize AI applications while managing access and costs.
★ 26,029 · PythonFROM PROTOTYPE TO ENTERPRISE
Complete step-by-step tutorials for building GenAI agents for production — from prototype to enterprise deployment.
★ 20,541 · Jupyter NotebookML-ENGINEERING OPEN BOOK
Open book on ML engineering with practical materials and examples in Python.
★ 19,717 · PythonAGENT-LIGHTNING - TRAIN AI AGENTS
Platform for fast training and deployment of AI agents in Python. Enables faster creation of intelligent assistants.
★ 18,957 · PythonOPENLLM: RUN LLMS AS OPENAI API
OpenLLM allows running any open-source LLMs (Llama, Qwen, DeepSeek) as OpenAI-compatible APIs with a single command. Includes chat UI, modern inference backends, and read
★ 12,607 · PythonTensorZero: LLMOps Platform
An open LLMOps platform that unifies LLM gateway, observability, evaluation, optimization, and experiments.
★ 11,366 · RustMETAFLOW — ML MANAGEMENT
Metaflow simplifies building, managing, and deploying AI/ML systems on Python, allowing focus on data science.
★ 10,114 · PythonBENTOML PATH TO AI API
Serve models and AI applications in minutes: API, queues, multi‑model pipelines, and LLM services.
★ 8,663 · PythonFLYTE: AI Workflow Orchestration
Flyte is a dynamic and resilient platform for AI orchestration, enabling easy unification of data, models, and compute resources into cohesive workflows.
★ 7,059 · GoZENML: AI PLATFORM FROM PIPELINE
ZenML is a Python framework for creating AI pipelines and agents, unifying data, models, and orchestration in a single platform.
★ 5,636 · PythonGISKARD-OSS - LLM AGENT EVALUATION
Library for evaluating and testing LLM agents with open-source code.
★ 5,417 · PythonARGILLA - CREATE DATASETS FASTER
Argilla helps AI engineers and domain experts collaboratively create high-quality datasets for training models.
★ 5,203 · PythonList of Top AI Tools
A collection of the best tools for working with artificial intelligence: frameworks, libraries, and services.
★ 5,193Universal FedML Platform
A universal library for distributed training, model serving, and federated learning with a cross-cloud scheduler.
★ 4,046 · PythonSYNAPSA COMMONS: FREE AI COURSES
Free practical AI courses in Colab, Kaggle, Binder, Codespaces and Jupyter. They include evidence of EU AI Act compliance, model validation, document extraction, search a
★ 4,026 · PythonSWANLAB: TRACKING AND VISUALIZATION
SwanLab is an open-source tool for tracking and visualizing AI model training, compatible with PyTorch, Transformers, and other frameworks.
★ 3,981 · PythonAI‑ENGINEER HQ: SCIENCE CORE
The project contains Jupyter notebooks with methods for training models, RAG pipelines on LangChain and data structure algorithms for AI agents. It allows quickly creatin
★ 3,780 · Jupyter NotebookOpen AI Catalog
A list of the best truly open-source AI projects, models, tools, and infrastructure. Helps developers find high-quality open-source resources.
★ 3,559 · PythonDATACHAIN - DATA WITH AI
Typed versioned datasets for unstructured data on top of S3, GCS, and Azure. A great tool for working with AI information.
★ 2,748 · PythonHAMILTON - MODULAR DATAFLOW
Apache Hamilton simplifies creating testable, self-documenting data pipelines with lineage tracking.
★ 2,512 · Jupyter NotebookTrainer: Distributed Training
The trainer project enables distributed training of AI models and fine‑tuning of LLMs in Kubernetes, written in Go.
★ 2,284 · GoVLLM-ASCEND: ASCEND PLUGIN ON GITHUB
Community plugin for vLLM on Ascend hardware from the community, written in C++. Gaining stars — already 2156!
★ 2,156 · C++SUPERLINKED INFERENCE ENGINE
Open-source server for embedding inference, reranking, and data extraction. 2000+ stars on GitHub.
★ 2,029 · PythonKATIB DEPRECATED: MIGRATE TO TRAINER
Project Katib is deprecated. Migrate to OptimizationJob and Kubeflow Trainer for hyperparameter tuning.
★ 1,708 · PythonPIXELTABLE — DECLARATIVE AI BACKEND
Pixeltable is a declarative, incremental backend for multimodal AI applications, simplifying work with data and models.
★ 1,569 · Python🔥 GPU REAL‑TIME DASHBOARD
GPU-hot — a web dashboard for monitoring NVIDIA GPU showing temperature, load, and memory in real time. Already over 1,500 stars on GitHub! 🌟
★ 1,543 · JavaScriptLLM Inference Optimization Roadmap
A 10‑week plan to study the service and accelerate large language models, covering vLLM, SGLang, quantization, and speculative decoding practices.
★ 1,179 · HTMLAI Agent 24/7
An autonomous AI agent runs your deep experiments 24/7, saving resources and memory. The Leader‑Worker architecture ensures stable operation at zero cost.
★ 1,035 · PythonAgileRL - Evolutionary Acceleration
AgileRL speeds up RL training 10× via evolutionary hyperparameter optimization and ready-to-use SOTA algorithms.
★ 967 · PythonMOSEC - MAXIMUM ML PRODUCTIVITY
Fast framework for serving ML models with dynamic batching and CPU/GPU pipelines.
★ 904 · PythonML Models Compiler to C99
An AOT compiler that converts XGBoost, LightGBM, scikit-learn, CatBoost, and ONNX models into native C99 code, achieving inference speedups of up to 336× compared to Pyth
★ 680 · PythonVECTORHUB - DEPRECATED REPOSITORY FOR EMBEDDINGS
The archived VectorHub project showcases early work on vector search. The team is now focused on SIE — a self-hosted engine for embeddings, ranking, and document processi
★ 535 · Jupyter NotebookAwesome MLSecOps Resources
A curated collection of tools, articles, and resources on machine learning security and MLOps.
★ 492PLATFORM FOR AI AGENTS
The open CAIPE platform helps create, deploy, and manage AI agents and their workflows on TypeScript.
★ 444 · TypeScriptTEMPLATE GENAIOPS PROMPT FLOW
Template GenAIOps with Prompt Flow simplifies creation of LLM applications through centralized hosting, lifecycle management, and experiments with prompt variants and hyp
★ 370 · PythonMATRIXHUB: AI Hub – Open Source
Self-hosted platform for AI models with Hugging Face compatibility and vLLM/SGLang acceleration. Stars: 246 ⭐
★ 367 · GoKITARU: AI AGENTS IN PRODUCTION
kitaru lets you record, replay, and improve AI agents in production on ZenML. Debugging and optimization become simpler and faster.
★ 319 · PythonAI Engineering Lab Course
Free self-study 24-week AI engineering course: Python, machine learning, LLMs, RAG, fine-tuning, agents, and work with Azure, Vertex, Bedrock, and Databricks. 43 interact
★ 318 · Jupyter NotebookFLAMA: ONE LINE FOR AI API
Framework for fast deployment of AI models as API with built-in chat and MCP support.
★ 307 · PythonTITLE - HONGBOMIAO LAB
Personal R&D laboratory on Python with 298 stars, uniting developers to share knowledge and grow together.
★ 300 · PythonAWESOME RAG PRODUCTION
List of proven tools and practices for building scalable RAG systems in Python.
★ 295 · PythonInteractive MLOps Learning Tools
Free interactive tools for learning MLOps, ML system design, and agentic analytics with simulators and system maps.
★ 267HEALTHCHAIN: AI FOR MEDICAL DATA
Python SDK that connects AI models to real‑world EHR systems, eliminating complex integration.
★ 231 · Pythonhaystack-core-integrations - SCALE HAYSTACK FAST
Additional packages for Haystack: components, document stores, and other tools extending its capabilities.
★ 212 · PythonEVALFORGE — LLM EVALUATION IN CI
EvalForge is a tool for LLM evaluation in CI/CD. Provides evaluator-neutral evidence, baseline regression gates, and JSON, JUnit, SARIF reports. Integrates with GitHub Ac
★ 194 · PythonComprehensive AI Engineering Course
Free 173-lesson course covering data, ML, deep learning, and AI engineering with 166 runnable labs. Covers math, code, systems, and security under CC BY-NC 4.0.
★ 175 · PythonNew projects on this topic in Telegram
Telegram →