Qlora: open-source projects on GitHub
13 repositories on Qlora, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
LlamaFactory: Unified LLM Tuning
LlamaFactory offers a unified library for efficient fine‑tuning of 100+ LLMs and VLMs, with support for LoRA, QLoRA and distributed multi‑GPU training.
★ 71,186 · PythonAIRLLM: 70B Model on 4GB GPU
Running huge LLMs on weak hardware. AirLLM enables inference of 70B models on a single 4GB GPU.
★ 42,461 · Jupyter NotebookSoup: Train LLM Easily
Soup fine-tunes an LLM from a single YAML using a streaming layer — enabling an 8B model to run on a laptop with 4 GB VRAM.
★ 10,552 · PythonBITSANDBYTES: LLM COMPRESSION
Library for k-bit quantization of large language models, enabling LLM execution on regular hardware via PyTorch.
★ 8,246 · PythonHALO: FRAMEWORK FOR LLM TRAINING
Halo is an open-source framework from White Circle for training large language and multimodal models. It supports agent-based training, async-RL, distributed training, an
★ 862 · PythonPMETAL: THE ACCEL LLM ON APPLE SILICON
PMetal — Rust framework for high‑performance LLM inference on Apple Silicon. Supports local inference, LoRA/QLoRA fine‑tuning, serving, quantization, and MLX/Metal accele
★ 333 · RustMini-Verl on One GPU
The project allows running a documented subset of verl-style OPD on a single consumer GPU, using typed configuration, Parquet prompts, and PEFT scaling artifacts.
★ 311 · PythonLight fine-tuning of LLM assistants
Zero-friction fine-tuning of any LLMs for Claude Code, Gemini CLI, and ACP agents: from environment setup to training (LoRA, SFT, DPO, GRPO) with NVIDIA and Apple Silicon
★ 237 · PythonLoRA Fine-Tuning Sprint
Project accelerates LoRA fine-tuning by fixing task and hardware, and posts results to a public wall-clock leaderboard based on modified nanogpt.
★ 151 · PythonSecure LLM for Code
An LLM-based system that analyzes AI-generated code for vulnerabilities and suggests automatic fixes. Integrated into CI/CD for continuous application protection.
★ 57 · PythonAI Agent Recovery Controller
Open-source tool for managing execution and recovery of AI agents that use code and external tools. Ensures reliable task execution and automatic rollback on errors.
★ 54 · PythonCan I finetune this?
Tool to check whether a Hugging Face model fits in your GPU memory and can be fine-tuned locally.
★ 31 · PythonSparkDuet: on-demand model library
The project provides a single OpenAI‑compatible endpoint for running DeepSeek and Qwen models. It serves them via two vLLM lanes (TP=2) on an NVIDIA DGX Spark cluster and
★ 0 · PythonNew projects on this topic in Telegram
Telegram →