Amd: open-source projects on GitHub
16 repositories on Amd, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
High-performance LLM engine
A high-performance and memory-efficient engine for inference and serving large language models.
★ 79,783 · PythonLMCache: LLM Acceleration
The fastest KV cache layer for large language models, boosting performance and reducing latency.
★ 8,292 · PythonODS - YOUR AI SERVER
ODS turns any computer into a powerful AI server: LLM inference, chat, voice, agents, RAG, and image generation.
★ 7,832 · ShellLemonade SDK
Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!
★ 4,059 · C++FAST LLM LAUNCH ON NPU
FastFlowLM runs LLMs on AMD Ryzen AI NPU in minutes, delivering performance comparable to Ollama but optimized for NPU.
★ 2,050 · C++UCCL: GPU Communication at Max
A fast library for efficient data exchange between GPUs: collective operations, P2P, and inference acceleration.
★ 1,586 · C++FAST LLM ON AMD
Run LLM on AMD Ryzen™ AI in minutes. Like Ollama, but deeply optimized for AMD chips! C++
★ 1,464 · C++FAST LAUNCH QWEN3.8 ON AMD
The project provides scripts for instant deployment of Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151) GPU via HIP. All dependencies are built automatically, and inference
★ 1,349 · ShellGUFO: INFERENCE ENGINE FOR STRIX HALO
gufo — inference engine for AMD Strix Halo in C++. Qwen Flash Next Q4_K_XL delivers 59.41 tok/s (1 user) and 157.22 tok/s (8 users). Qwen27B Q4_K_XL with DFlash2 gives 70
★ 1,176 · C++InferenceX – Inference Benchmark
Open-source continuous inference benchmark for Qwen3.5, DeepSeek, GPTOSS and new accelerators.
★ 1,016 · PythonDreamServer: Local AI
DreamServer is an open-source project for running LLMs locally with a chat interface, voice control, agents, workflows, RAG, and image generation, operating without cloud
★ 523 · PythonLOCAL SPEECH-TO-SPEECH ASSISTANT ON GPU
Fully local voice assistant with ~0.23s latency from end of phrase to answer. Runs on AMD/Nvidia GPU under Windows and Linux without sending audio to cloud.
★ 448 · PythonZINC - LOCAL LLM ON GPU
Zinc is an LLM inference engine in Zig that runs on AMD GPU and Apple Silicon without external dependencies.
★ 395 · ZigSTRIX HALO LLM Setup
Guide for LLM on Ryzen AI MAX+ 395 and Radeon 8060S via Ollama, llama.cpp and ROCm. Achieving 100 tokens/s 30B Qwen and 140 tokens/s CHADROCK MTP.
★ 373 · PythonHYPERLOOM AUTO-OPTIMIZATION LLM ON AMD
Hyperloom — agentic system that automatically optimizes LLM workloads on AMD GPUs by selecting kernels and tuning parameters for peak performance without manual setup.
★ 271 · PythonAMD Strix Halo Inference Engine
Kyojin runs ExLlamaV3 on AMD Strix Halo (ROCm gfx1151) to execute 300B‑parameter Mixture‑of‑Experts models on a single 128 GB mini PC.
★ 238 · PythonNew projects on this topic in Telegram
Telegram →