R_REDDYX.XYZ

Vulkan: open-source projects on GitHub

15 repositories on Vulkan, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Gguf 47Rocm 12Cuda 48Llama Cpp 56Metal 32Local LLM 107GPU 48Llama 106MCP Server 631Openai API 86Moe 23Speculative Decoding 23Deep Learning 105
Tencent/ncnn

HIGH-PERFORMANCE NEURAL NETWORK INFERENCE FRAMEWORK FOR MOBILE

ncnn is a neural network inference framework with no third-party dependencies for mobile, embedded, and desktop platforms. Supports CPU and Vulkan GPU backends, includes

★ 24,068 · C++
alibaba/MNN

MNN: FAST AI ON DEVICE

Lightweight and lightning-fast inference engine from Alibaba for on-device LLM and Edge AI.

★ 15,386 · C++
Dav1dde/glad

GLAD - Multi-Language Vulkan Loader

Automatic loader generator for Vulkan, OpenGL, GLES, EGL, GLX and WGL based on specifications. Supports C and simplifies integration.

★ 4,636 · C
0xShug0/audio.cpp

Pure C++ Audio Inference Engine

All-in-one C++ inference engine for audio models (TTS, STT, VAD, voice conversion, music generation) powered by ggml, with zero Python dependencies and highly optimized p

★ 4,234 · C++
lemonade-sdk/lemonade

Lemonade SDK

Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!

★ 4,059 · C++
withcatai/node-llama-cpp

RUN LLM LOCALLY IN NODE.JS

Run AI models directly on your computer via Node.js. Enforced JSON schema validation right at the generation level.

★ 2,205 · TypeScript
voyager-so/vork

Headless 3D Engine for AI Agents

A Rust-based headless 3D and VFX engine designed for AI agents to simulate, render, and interact with virtual environments without a GUI.

★ 1,565 · Rust
prabanta-dev/janas

JANAS: FAST LLM INFERENCE!!

janas runs huge LLM (up to 48 GB) on a 32 GB laptop, outpacing llama.cpp 8‑10×. On Qwen3-Next-80B it gives 37 tok/s w/o draft and 62 tok/s reading GGUF. Supports CPU+GPU

★ 712 · C
apistol78/traktor

IEEE 1876-2019 NETWORK LEARNING SYSTEMS

Format for describing ready-to-use AI agents for IT teams. Open IEEE standard for knowledge exchange among virtual engineers.

★ 586 · C++
hybridgroup/yzma

YZMA: Local LLM in Go

Integration of llama.cpp into Go applications for local inference with hardware acceleration. 496 stars on GitHub.

★ 496 · Go
GabrieleLozupone/kokon

LOCAL AI PHOTO EDITOR ON YOUR GPU

kokon — open-source photo editor by text description. Runs on your GPU: photos never leave computer, no daily limits. One installer for Windows, Mac, Linux sets up Qwen-I

★ 410 · Rust
hogeheer499-commits/strix-halo-guide

STRIX HALO LLM Setup

Guide for LLM on Ryzen AI MAX+ 395 and Radeon 8060S via Ollama, llama.cpp and ROCm. Achieving 100 tokens/s 30B Qwen and 140 tokens/s CHADROCK MTP.

★ 373 · Python
ravencaio/tlou-remastered-pc

Native PC Port of TLOU Remastered

Native Windows port running PS4 game code via custom runtime with reimplemented system libraries and Vulkan renderer. Requires original game files.

★ 345 · C++
raketenkater/ggrun

Not a Llama, no stance

Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.

★ 284 · Go
RustingStudio/RustingStrata

PURE-RUST ENGINE FOR QWEN GGUF

RustingStrata is a pure-Rust inference engine for Qwen GGUF (Qwen3–3.8, MoE up to 770B+). Supports CUDA/Vulkan, hybrid CPU+GPU experts, MTP speculative decoding. Up to 1.

★ 231 · Rust

New projects on this topic in Telegram

Telegram →
Vulkan — 15 open-source GitHub projects | REDDYX AI