R_REDDYX.XYZ

Amd: open-source projects on GitHub

16 repositories on Amd, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Rocm 12Cuda 48Inference 95Llama 106Pytorch 98Nvidia 24GPU 48Deepseek 229Qwen 106Qwen3 30Vllm 69AI Agents 1319Llama Cpp 56
vllm-project/vllm

High-performance LLM engine

A high-performance and memory-efficient engine for inference and serving large language models.

★ 79,783 · Python
LMCache/LMCache

LMCache: LLM Acceleration

The fastest KV cache layer for large language models, boosting performance and reducing latency.

★ 8,292 · Python
Osmantic/ODS

ODS - YOUR AI SERVER

ODS turns any computer into a powerful AI server: LLM inference, chat, voice, agents, RAG, and image generation.

★ 7,832 · Shell
lemonade-sdk/lemonade

Lemonade SDK

Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!

★ 4,059 · C++
ROCm/FastFlowLM

FAST LLM LAUNCH ON NPU

FastFlowLM runs LLMs on AMD Ryzen AI NPU in minutes, delivering performance comparable to Ollama but optimized for NPU.

★ 2,050 · C++
uccl-project/uccl

UCCL: GPU Communication at Max

A fast library for efficient data exchange between GPUs: collective operations, P2P, and inference acceleration.

★ 1,586 · C++
FastFlowLM/FastFlowLM

FAST LLM ON AMD

Run LLM on AMD Ryzen™ AI in minutes. Like Ollama, but deeply optimized for AMD chips! C++

★ 1,464 · C++
peonist-ai/halogen-flash-server

FAST LAUNCH QWEN3.8 ON AMD

The project provides scripts for instant deployment of Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151) GPU via HIP. All dependencies are built automatically, and inference

★ 1,349 · Shell
gufo-org/gufo

GUFO: INFERENCE ENGINE FOR STRIX HALO

gufo — inference engine for AMD Strix Halo in C++. Qwen Flash Next Q4_K_XL delivers 59.41 tok/s (1 user) and 157.22 tok/s (8 users). Qwen27B Q4_K_XL with DFlash2 gives 70

★ 1,176 · C++
SemiAnalysisAI/InferenceX

InferenceX – Inference Benchmark

Open-source continuous inference benchmark for Qwen3.5, DeepSeek, GPTOSS and new accelerators.

★ 1,016 · Python
Light-Heart-Labs/DreamServer

DreamServer: Local AI

DreamServer is an open-source project for running LLMs locally with a chat interface, voice control, agents, workflows, RAG, and image generation, operating without cloud

★ 523 · Python
JMS1717/ming-voice

LOCAL SPEECH-TO-SPEECH ASSISTANT ON GPU

Fully local voice assistant with ~0.23s latency from end of phrase to answer. Runs on AMD/Nvidia GPU under Windows and Linux without sending audio to cloud.

★ 448 · Python
zolotukhin/zinc

ZINC - LOCAL LLM ON GPU

Zinc is an LLM inference engine in Zig that runs on AMD GPU and Apple Silicon without external dependencies.

★ 395 · Zig
hogeheer499-commits/strix-halo-guide

STRIX HALO LLM Setup

Guide for LLM on Ryzen AI MAX+ 395 and Radeon 8060S via Ollama, llama.cpp and ROCm. Achieving 100 tokens/s 30B Qwen and 140 tokens/s CHADROCK MTP.

★ 373 · Python
AMD-AGI/Hyperloom

HYPERLOOM AUTO-OPTIMIZATION LLM ON AMD

Hyperloom — agentic system that automatically optimizes LLM workloads on AMD GPUs by selecting kernels and tuning parameters for peak performance without manual setup.

★ 271 · Python
Yamz-Labs/kyojin

AMD Strix Halo Inference Engine

Kyojin runs ExLlamaV3 on AMD Strix Halo (ROCm gfx1151) to execute 300B‑parameter Mixture‑of‑Experts models on a single 128 GB mini PC.

★ 238 · Python

New projects on this topic in Telegram

Telegram →
Amd — 16 open-source GitHub projects | REDDYX AI