Vulkan: open-source projects on GitHub
15 repositories on Vulkan, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
HIGH-PERFORMANCE NEURAL NETWORK INFERENCE FRAMEWORK FOR MOBILE
ncnn is a neural network inference framework with no third-party dependencies for mobile, embedded, and desktop platforms. Supports CPU and Vulkan GPU backends, includes
★ 24,068 · C++MNN: FAST AI ON DEVICE
Lightweight and lightning-fast inference engine from Alibaba for on-device LLM and Edge AI.
★ 15,386 · C++GLAD - Multi-Language Vulkan Loader
Automatic loader generator for Vulkan, OpenGL, GLES, EGL, GLX and WGL based on specifications. Supports C and simplifies integration.
★ 4,636 · CPure C++ Audio Inference Engine
All-in-one C++ inference engine for audio models (TTS, STT, VAD, voice conversion, music generation) powered by ggml, with zero Python dependencies and highly optimized p
★ 4,234 · C++Lemonade SDK
Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!
★ 4,059 · C++RUN LLM LOCALLY IN NODE.JS
Run AI models directly on your computer via Node.js. Enforced JSON schema validation right at the generation level.
★ 2,205 · TypeScriptHeadless 3D Engine for AI Agents
A Rust-based headless 3D and VFX engine designed for AI agents to simulate, render, and interact with virtual environments without a GUI.
★ 1,565 · RustJANAS: FAST LLM INFERENCE!!
janas runs huge LLM (up to 48 GB) on a 32 GB laptop, outpacing llama.cpp 8‑10×. On Qwen3-Next-80B it gives 37 tok/s w/o draft and 62 tok/s reading GGUF. Supports CPU+GPU
★ 712 · CIEEE 1876-2019 NETWORK LEARNING SYSTEMS
Format for describing ready-to-use AI agents for IT teams. Open IEEE standard for knowledge exchange among virtual engineers.
★ 586 · C++YZMA: Local LLM in Go
Integration of llama.cpp into Go applications for local inference with hardware acceleration. 496 stars on GitHub.
★ 496 · GoLOCAL AI PHOTO EDITOR ON YOUR GPU
kokon — open-source photo editor by text description. Runs on your GPU: photos never leave computer, no daily limits. One installer for Windows, Mac, Linux sets up Qwen-I
★ 410 · RustSTRIX HALO LLM Setup
Guide for LLM on Ryzen AI MAX+ 395 and Radeon 8060S via Ollama, llama.cpp and ROCm. Achieving 100 tokens/s 30B Qwen and 140 tokens/s CHADROCK MTP.
★ 373 · PythonNative PC Port of TLOU Remastered
Native Windows port running PS4 game code via custom runtime with reimplemented system libraries and Vulkan renderer. Requires original game files.
★ 345 · C++Not a Llama, no stance
Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.
★ 284 · GoPURE-RUST ENGINE FOR QWEN GGUF
RustingStrata is a pure-Rust inference engine for Qwen GGUF (Qwen3–3.8, MoE up to 770B+). Supports CUDA/Vulkan, hybrid CPU+GPU experts, MTP speculative decoding. Up to 1.
★ 231 · RustNew projects on this topic in Telegram
Telegram →