R_REDDYX.XYZ

Rocm: open-source projects on GitHub

12 repositories on Rocm, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Amd 16Cuda 48Local LLM 107Inference 95Vllm 69LLM Inference 76Openai API 86Vulkan 15Llama 106Qwen 106Sglang 24Gguf 47Pytorch 98
LMCache/LMCache

LMCache: LLM Acceleration

The fastest KV cache layer for large language models, boosting performance and reducing latency.

★ 8,292 · Python
gpustack/gpustack

GPU cluster manager

Management of GPU clusters with automatic configuration and orchestration of inference engines (vLLM, SGLang) for high-performance deployment of AI models.

★ 5,041 · Python
lemonade-sdk/lemonade

Lemonade SDK

Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!

★ 4,059 · C++
mw00/project-maya

PROJECT MAYA: LOCAL LLM ENGINE

Project Maya lets you run GLM-5.3-Flash (321B MoE) locally on a single GPU or up to 16 GPUs, supporting NVIDIA and AMD on Linux and Windows. The package includes engine,

★ 2,898 · C++
peonist-ai/halogen-flash-server

FAST LAUNCH QWEN3.8 ON AMD

The project provides scripts for instant deployment of Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151) GPU via HIP. All dependencies are built automatically, and inference

★ 1,349 · Shell
SemiAnalysisAI/InferenceX

InferenceX – Inference Benchmark

Open-source continuous inference benchmark for Qwen3.5, DeepSeek, GPTOSS and new accelerators.

★ 1,016 · Python
hybridgroup/yzma

YZMA: Local LLM in Go

Integration of llama.cpp into Go applications for local inference with hardware acceleration. 496 stars on GitHub.

★ 496 · Go
JMS1717/ming-voice

LOCAL SPEECH-TO-SPEECH ASSISTANT ON GPU

Fully local voice assistant with ~0.23s latency from end of phrase to answer. Runs on AMD/Nvidia GPU under Windows and Linux without sending audio to cloud.

★ 448 · Python
hogeheer499-commits/strix-halo-guide

STRIX HALO LLM Setup

Guide for LLM on Ryzen AI MAX+ 395 and Radeon 8060S via Ollama, llama.cpp and ROCm. Achieving 100 tokens/s 30B Qwen and 140 tokens/s CHADROCK MTP.

★ 373 · Python
raketenkater/ggrun

Not a Llama, no stance

Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.

★ 284 · Go
AMD-AGI/Hyperloom

HYPERLOOM AUTO-OPTIMIZATION LLM ON AMD

Hyperloom — agentic system that automatically optimizes LLM workloads on AMD GPUs by selecting kernels and tuning parameters for peak performance without manual setup.

★ 271 · Python
Yamz-Labs/kyojin

AMD Strix Halo Inference Engine

Kyojin runs ExLlamaV3 on AMD Strix Halo (ROCm gfx1151) to execute 300B‑parameter Mixture‑of‑Experts models on a single 128 GB mini PC.

★ 238 · Python

New projects on this topic in Telegram

Telegram →
Rocm — 12 open-source GitHub projects | REDDYX AI