R_REDDYX.XYZ

Qlora: open-source projects on GitHub

13 repositories on Qlora, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Fine Tuning 50Lora 67Peft 13Transformers 50Quantization 34Pytorch 98Qwen 106Rlhf 21Machine Learning 190Agent 547Deepseek 229Large Language Models 154Llama 106
hiyouga/LlamaFactory

LlamaFactory: Unified LLM Tuning

LlamaFactory offers a unified library for efficient fine‑tuning of 100+ LLMs and VLMs, with support for LoRA, QLoRA and distributed multi‑GPU training.

★ 71,186 · Python
lyogavin/airllm

AIRLLM: 70B Model on 4GB GPU

Running huge LLMs on weak hardware. AirLLM enables inference of 70B models on a single 4GB GPU.

★ 42,461 · Jupyter Notebook
MakazhanAlpamys/Soup

Soup: Train LLM Easily

Soup fine-tunes an LLM from a single YAML using a streaming layer — enabling an 8B model to run on a laptop with 4 GB VRAM.

★ 10,552 · Python
bitsandbytes-foundation/bitsandbytes

BITSANDBYTES: LLM COMPRESSION

Library for k-bit quantization of large language models, enabling LLM execution on regular hardware via PyTorch.

★ 8,246 · Python
whitecircle/halo

HALO: FRAMEWORK FOR LLM TRAINING

Halo is an open-source framework from White Circle for training large language and multimodal models. It supports agent-based training, async-RL, distributed training, an

★ 862 · Python
Epistates/pmetal

PMETAL: THE ACCEL LLM ON APPLE SILICON

PMetal — Rust framework for high‑performance LLM inference on Apple Silicon. Supports local inference, LoRA/QLoRA fine‑tuning, serving, quantization, and MLX/Metal accele

★ 333 · Rust
DaoyuanLi2816/mini-verl

Mini-Verl on One GPU

The project allows running a documented subset of verl-style OPD on a single consumer GPU, using typed configuration, Parquet prompts, and PEFT scaling artifacts.

★ 311 · Python
TYH-labs/unsloth-buddy

Light fine-tuning of LLM assistants

Zero-friction fine-tuning of any LLMs for Claude Code, Gemini CLI, and ACP agents: from environment setup to training (LoRA, SFT, DPO, GRPO) with NVIDIA and Apple Silicon

★ 237 · Python
Saivineeth147/lora-speedrun

LoRA Fine-Tuning Sprint

Project accelerates LoRA fine-tuning by fixing task and hardware, and posts results to a public wall-clock leaderboard based on modified nanogpt.

★ 151 · Python
trynullsec/nullsec-s1

Secure LLM for Code

An LLM-based system that analyzes AI-generated code for vulnerabilities and suggests automatic fixes. Integrated into CI/CD for continuous application protection.

★ 57 · Python
usedotai/dot-reflex

AI Agent Recovery Controller

Open-source tool for managing execution and recovery of AI agents that use code and external tools. Ensures reliable task execution and automatic rollback on errors.

★ 54 · Python
DaoyuanLi2816/can-i-finetune-this

Can I finetune this?

Tool to check whether a Hugging Face model fits in your GPU memory and can be fine-tuned locally.

★ 31 · Python
zorost/sparkduet

SparkDuet: on-demand model library

The project provides a single OpenAI‑compatible endpoint for running DeepSeek and Qwen models. It serves them via two vLLM lanes (TP=2) on an NVIDIA DGX Spark cluster and

★ 0 · Python

New projects on this topic in Telegram

Telegram →
Qlora — 13 open-source GitHub projects | REDDYX AI