Nvidia: open-source projects on GitHub
24 repositories on Nvidia, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
ODS - YOUR AI SERVER
ODS turns any computer into a powerful AI server: LLM inference, chat, voice, agents, RAG, and image generation.
★ 7,832 · ShellOpenWhispr: Voice Dictation
An app for speech-to-text conversion with support for local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy first, available on all platforms.
★ 3,216 · TypeScriptNVIDIA NEMOTRON: TRAINING RECIPES AND DEPLOYMENT
NVIDIA repository with training recipes, deployment guides, and usage examples for Nemotron models. Supports multimodal agents with up to 1M token context.
★ 2,361 · Jupyter NotebookNVIDIA Data Designer
NeMo Data Designer: generation of high-quality synthetic data from scratch or based on seed data. Ideal for training and fine-tuning models.
★ 1,877 · PythonNVIDIA GPU METRICS FOR PROMETHEUS
Exporter of NVIDIA GPU metrics to Prometheus in Go. Monitoring temperature, utilization, and memory via nvidia-smi.
★ 1,590 · GoUCCL: GPU Communication at Max
A fast library for efficient data exchange between GPUs: collective operations, P2P, and inference acceleration.
★ 1,586 · C++🔥 GPU REAL‑TIME DASHBOARD
GPU-hot — a web dashboard for monitoring NVIDIA GPU showing temperature, load, and memory in real time. Already over 1,500 stars on GitHub! 🌟
★ 1,543 · JavaScriptPAPERTHIN: SKILLS FOR RECURSIVE RSI
OpenAI hackathon winner's project on recursive agent self-improvement. Unpacks NVIDIA's zero-touch proof into engineering practice. Ready skillset for autonomous coding a
★ 1,445 · JavaScriptFAST OCR SERVER ON GPU
TurboOCR — a lightning-fast OCR server on TensorRT FP16 with PP-OCRv5 support, processing 270 images/sec on FUNSD via HTTP + gRPC API.
★ 1,160 · C++InferenceX – Inference Benchmark
Open-source continuous inference benchmark for Qwen3.5, DeepSeek, GPTOSS and new accelerators.
★ 1,016 · PythonSurvive LLM Chaos
Open-source Go tool for fine-tuning, building, and deploying LLMs with a single command.
★ 545 · GoREMOVES ADS BEFORE PLAYBACK
MinusPod — a self-hosted Python server that intercepts media streams and removes ads before playback using LLM Claude. Users get clean content without interruptions, with
★ 545 · PythonDreamServer: Local AI
DreamServer is an open-source project for running LLMs locally with a chat interface, voice control, agents, workflows, RAG, and image generation, operating without cloud
★ 523 · PythonTAU: Dev Agent Orchestrator
A single orchestrator for managing dev agents, sessions, and environments. Everything under control.
★ 429 · TypeScriptQA‑PILOT CHAT ASSISTANT FOR CODE
QA‑Pilot — an interactive chat that uses online or local LLMs for quick understanding and navigation of any GitHub repository. The project helps find functions, explain c
★ 329 · SvelteGPU BY TURN WITHOUT CRASHES
Berth leases the GPU to chat, image, and voice engines in turn. Two processes never load together and crash each other. Single Go binary, no dependencies.
★ 297 · GoJITLLM: HIGH PERFORMANCE LLM ON JVM
JITLLM — Java framework for high‑performance LLM inference and serving on the JVM. Supports GPU acceleration, GGUF and quantized model formats, and integration with DeepS
★ 295 · JavaLLMKUBE: LLM IN KUBERNETES
LLMKube - Kubernetes operator for LLM inference on heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, Apple Silicon Metal. Supports llama.cpp, vLLm, TGI, mlx-server, multi
★ 266 · GoRUST RUNTIME FOR AI AGENTS
NeMo-Relay is a multi-language runtime for AI agents in Rust. Manages execution scope, lifecycle events, and middleware for tool and LLM calls. 201 stars on GitHub.
★ 245 · RustHOMELAB MONITOR DASHBOARD
Plug‑and‑play dashboard for homelab in a single container: monitoring GPU, local‑AI VRAM, Docker, systemd and host health. Built‑in read‑only MCP server gives AI agents a
★ 236 · Python125B MoE Inference on RTX
Run Qwen3.8-Flash-Next (125B MoE) with 1M context on one or two RTX 3080 10GB cards. Tuned, benchmarked fork of Strata.
★ 71 · C++SparklingKit: Local AI Platform
SparklingKit — a local toolkit for OCR, transcription, translation, image generation, and mind‑map creation, enabling composable workflows on DGX Spark.
★ 70 · TypeScriptAuto-labeling YOLO Training
Platform for automatic image and video labeling using VLM NVIDIA LocateAnything-3B, with manual correction and one-click YOLO model training.
★ 31 · PythonSparkDuet: on-demand model library
The project provides a single OpenAI‑compatible endpoint for running DeepSeek and Qwen models. It serves them via two vLLM lanes (TP=2) on an NVIDIA DGX Spark cluster and
★ 0 · PythonNew projects on this topic in Telegram
Telegram →