R_REDDYX.XYZ

Qwen3: open-source projects on GitHub

30 repositories on Qwen3, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Qwen 106Deepseek 229Llama 106Speculative Decoding 23GPT Oss 20Llama3 28Local LLM 107Moe 23RAG 533Deepseek R1 25LLM Inference 76Quantization 34Gguf 47
vllm-project/vllm

High-performance LLM engine

A high-performance and memory-efficient engine for inference and serving large language models.

★ 79,783 · Python
Mintplex-Labs/anything-llm

AI Productivity On-Device

A universal AI productivity tool that runs locally and guarantees complete privacy without complex setup.

★ 59,922 · JavaScript
modelscope/ms-swift

ms-swift: LLM training

A framework for fine-tuning 600+ language and 300+ multimodal models. Supports PEFT, full fine-tuning, CPT/SFT/DPO/GRPO.

★ 14,178 · Python
qualcomm/GenieX

GENIEX: LLMs on Devices

Run cutting-edge multimodal models on GPU, NPU, and CPU — from PC to mobile and IoT devices.

★ 8,530 · Rust
zilliztech/deep-searcher

DEEP SEARCHER AI AGENT

Deep‑searcher is an open‑source Python framework for deep research of private data. It offers an alternative to Reason and Search with agentic RAG, supporting Claude and

★ 8,395 · Python
qualcomm/nexa-sdk

NEXA-SDK AI Everywhere Always

Run cutting‑edge LLMs and VLMs on GPU, NPU, and CPU — from PC to mobile and IoT devices. Support for models like GPT‑OSS, Granite‑4, Qwen‑3‑VL, and more.

★ 8,094 · Rust
johnbean393/Sidekick

SIDEKICK: LOCAL AI CHAT

Sidekick — native macOS app for chatting with a local LLM, pulling answers from files, folders and web pages. Works fully offline on llama.cpp, no external APIs. Supports

★ 3,324 · Swift
syv-ai/HyperQwen

HyperQwen: Qwen on Consumer GPUs

The project optimizes running large Qwen models on available GPUs using vLLM patches and requantization. It achieves 127 tokens/s on 24 GB.

★ 2,713 · Python
papersgpt/papersgpt-for-zotero

PAPERSGPT — AI for Zotero

Powerful AI plugin for Zotero with support for ChatGPT, Gemini, Claude, DeepSeek and other models. 2459 stars!

★ 2,709 · JavaScript
meizhong986/WhisperJAV

WHISPERJAV NOISE-FREE SUBTITLES

Subtitle generator for video based on Qwen3‑ASR, Whisper, and local LLM, noise-resistant and ideal for JAV content.

★ 2,465 · Python
RunanywhereAI/wally

VOICE ASSISTANT FOR MAC

Wally lets you control Mac by voice and search local documents offline without internet. It runs on Apple Silicon M1 using an on-device offline LLM via llama.cpp and RAG

★ 1,571 · C++
RunanywhereAI/RCLI

RCLI — Voice AI

Voice AI with RAG, no cloud: chat with Mac and request documents locally.

★ 1,507 · C++
peonist-ai/halogen-flash-server

FAST LAUNCH QWEN3.8 ON AMD

The project provides scripts for instant deployment of Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151) GPU via HIP. All dependencies are built automatically, and inference

★ 1,349 · Shell
synchopate/llama-modchip

RUN 284B LLM ON CPU WITHOUT GPU

llama-modchip runs DeepSeek-V4-Flash 284B on pure 64GB CPU RAM: 44.4 tok/s prefill, 9-14 tok/s generation. 30B MoE models up to 111 tok/s. 256K context, Claude Code resto

★ 1,234 · Python
EvolvingLMMs-Lab/LLaVA-OneVision-2

MULTIMODAL FUTURE IS HERE

Fully open-source framework for training multimodal models — accessible to everyone. Python.

★ 1,050 · Python
YeonwooSung/llm-architecture-from-scratch

IMPLEMENTING LLM ARCHITECTURES FROM SCRATCH

The project contains clean implementations of modern LLM architectures in PyTorch. Includes DeepSeek-R1, DeepSeek-V3, Gemma 3, Kimi K2, and Llama 4. Perfect for studying

★ 856 · Python
ARahim3/kaggle-tpu-lab

FREE TPU FOR QWEN3.8-27B

The kaggle-tpu-lab project runs Qwen3.8-27B (bf16) on a free Kaggle TPU, providing an OpenAI‑compatible API. It supports a 262k token context and ~130 tokens/s speed, wor

★ 801 · Python
pegainfer-project/pegainfer

PEGAINFER: Rust + CUDA Infer

Pure Rust LLM engine with CUDA acceleration, OpenAI API compatible, runs Qwen3 and Kimi‑K2 without PyTorch.

★ 742 · Rust
prabanta-dev/janas

JANAS: FAST LLM INFERENCE!!

janas runs huge LLM (up to 48 GB) on a 32 GB laptop, outpacing llama.cpp 8‑10×. On Qwen3-Next-80B it gives 37 tok/s w/o draft and 62 tok/s reading GGUF. Supports CPU+GPU

★ 712 · C
zhongkaifu/TensorSharp

TENSORSHARP - POWERFUL .NET LLM

A library for quickly launching GGUF models on .NET with GPU support, console app, web chat, and an API compatible with Ollama and OpenAI.

★ 679 · C#
NVIDIA-NeMo/Automodel

AUTOMODEL — DISTRIBUTED LLM/VLM TRAINING

Native PyTorch library for distributed LLM/VLM training with out-of-the-box Hugging Face support. ⭐ 576 stars on GitHub.

★ 576 · Python
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-DFlash

QWEN3.6-27B ULTIMATE VERSION

Fully uncensored, enhanced version of Qwen3.6-27B with NVFP4 and DFlash speculative decoding.

★ 495 · Python
zolotukhin/zinc

ZINC - LOCAL LLM ON GPU

Zinc is an LLM inference engine in Zig that runs on AMD GPU and Apple Silicon without external dependencies.

★ 395 · Zig
JakeATX/llamAmpere

LLAMAMPERE: LLM ACCELERATION ON RTX 3090

llama.cpp fork optimized for Ampere GPUs. Delivers 110+ tok/s on Qwen 3.8 at 100K context. Runs on 12 GB VRAM with 200K+ context.

★ 380 · C++
hud-evals/hud-python

HUD-Python RL Evaluation

An OSS environment for RL with ready‑to‑use agent evaluation tools. Run, configure, and get results.

★ 329 · Python
sophgo/LLM-TPU

LLM-TPU - RUN AI ON BM1684X

Run generative AI models on Sophgo BM1684X/BM1688 with high speed and low power consumption.

★ 323 · C++
beehive-lab/jitllm

JITLLM: HIGH PERFORMANCE LLM ON JVM

JITLLM — Java framework for high‑performance LLM inference and serving on the JVM. Supports GPU acceleration, GGUF and quantized model formats, and integration with DeepS

★ 295 · Java
microsoft/AesCode

AESTHETIC HTML/CSS GENERATION FROM PROMPTS

AesCode turns prompts into editable HTML/CSS infographics. Uses image generators as aesthetic guidance and cross-modal rewards with RL (Qwen3) for verifiable code. 225★ o

★ 281 · Python
usedotai/dot-reflex

AI Agent Recovery Controller

Open-source tool for managing execution and recovery of AI agents that use code and external tools. Ensures reliable task execution and automatic rollback on errors.

★ 54 · Python
huyxdang/Text-GPT-Live

Training GPT for $50

The project shows how to train your own GPT-like model on a $50 budget using accessible cloud resources and open-source code.

★ 45 · Python

New projects on this topic in Telegram

Telegram →
Qwen3 — 30 open-source GitHub projects | REDDYX AI