R_REDDYX.XYZ

Transformers: open-source projects on GitHub

50 repositories on Transformers, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Pytorch 98Large Language Models 154Machine Learning 190Deep Learning 105Lora 67NLP 84Fine Tuning 50Huggingface 55Generative AI 192Artificial Intelligence 157GPT 153Peft 13Language Model 39
microsoft/generative-ai-for-beginners

21 Generative AI Lessons

Free course from Microsoft: 21 lessons to start in the world of generative AI. Over 111 thousand stars on GitHub!

★ 111,765 · Jupyter Notebook
rasbt/LLMs-from-scratch

Building LLM from Scratch

Step-by-step implementation of a ChatGPT-like model in PyTorch: tokenizer, architecture, training, and text generation.

★ 93,387 · Jupyter Notebook
hiyouga/LlamaFactory

LlamaFactory: Unified LLM Tuning

LlamaFactory offers a unified library for efficient fine‑tuning of 100+ LLMs and VLMs, with support for LoRA, QLoRA and distributed multi‑GPU training.

★ 71,186 · Python
deepset-ai/haystack

Haystack: AI Framework for LLM

An open framework for building production-ready LLM applications with modular control over search, routing, memory, and generation.

★ 25,289 · MDX
huggingface/peft

PEFT: Efficient AI Training

The PEFT library provides state-of-the-art parameter-efficient fine-tuning methods for models, reducing resources and training time.

★ 21,199 · Python
stas00/ml-engineering

ML-ENGINEERING OPEN BOOK

Open book on ML engineering with practical materials and examples in Python.

★ 19,717 · Python
arc53/DocsGPT

DocsGPT: Private AI Assistant

Private AI platform for agents, assistants, and enterprise search with support for multiple models.

★ 17,882 · Python
neuml/txtai

TXTAI — AI All-in-One

An algorithmic framework for semantic search, LLM orchestration, and language-model workflows. All in one!

★ 12,620 · Python
openvinotoolkit/openvino

OPTIMIZATION AND DEPLOYMENT OF AI MODELS

Toolkit for optimizing and deploying deep learning models. Supports conversion from PyTorch, TensorFlow, ONNX and inference on CPU, GPU, and Intel NPU.

★ 11,656 · C++
MakazhanAlpamys/Soup

Soup: Train LLM Easily

Soup fine-tunes an LLM from a single YAML using a streaming layer — enabling an 8B model to run on a laptop with 4 GB VRAM.

★ 10,552 · Python
Neywa-Labs/mlx-audio

MLX-AUDIO: SPEECH ON APPLE SILICON

mlx-audio — library for TTS, STT and STS on Apple's MLX framework. Runs efficiently on Apple Silicon. 8192 stars on GitHub.

★ 8,267 · Python
rohitg00/ai-engineering-from-scratch

AI engineering from scratch

Learn, build it, and deliver it to others.

★ 7,884 · Python
Blaizzy/mlx-audio

Speech Tools for MLX

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

★ 7,115 · Python
amazon-science/chronos-forecasting

CHRONOS-FORECASTING - SMART TIME SERIES FORECASTING

Chronos provides a set of pretrained models for accurate time series forecasting out of the box in Python.

★ 6,310 · Python
FareedKhan-dev/train-llm-from-scratch

TRAIN LLM FROM SCRATCH

A simple path from loading data to text generation with your own LLM.

★ 4,188 · Jupyter Notebook
JohnSnowLabs/spark-nlp

SPARK-NLP - REVOLUTION IN NLP

Spark NLP provides state-of-the-art NLP models and ready-to-use pipelines for scalable text processing in Scala.

★ 4,163 · Scala
SwanHubX/SwanLab

SWANLAB: TRACKING AND VISUALIZATION

SwanLab is an open-source tool for tracking and visualizing AI model training, compatible with PyTorch, Transformers, and other frameworks.

★ 3,981 · Python
roboflow/maestro

MAESTRO - Simplifying Model Fine-tuning

The project simplifies fine-tuning of multimodal models PaliGemma 2, Florence‑2, and Qwen2.5‑VL, saving developers time and resources.

★ 2,696 · Python
potamides/DeTikZify

DETIKZIFY DRAWS LATEX DIAGRAMS FAST

DeTikZify turns textual descriptions or hand‑drawn sketches into ready‑to‑use TikZ code for LaTeX. The project leverages HuggingFace and Llama models for inverse graphics

★ 1,831 · Python
peremartra/Large-Language-Model-Notebooks-Course

PRACTICAL COURSE ON LLM IN JUPYTER

The course consists of Jupyter notebooks teaching how to build chat‑bots, fine‑tune LLMs and work with Hugging Face, LangChain and RAG. Each block provides ready code and

★ 1,828 · Jupyter Notebook
nokia-applied-research/AnyJev

ANYJEV TURNS LLM INTO JEV-MODEL

AnyJev converts any LLM into a Jev‑style decision model, outputting typed decisions and real probabilities without requiring retraining. The project is actively developed

★ 1,609 · Python
OpenAdaptAI/OpenAdapt

OpenAdapt - Boundless AI Process

OpenAdapt — an open platform for generative process automation based on LLM, LAM, and VLM models. Python, 1.6k stars, AI-first approach to RPA.

★ 1,608 · Python
PrunaAI/pruna

PRUNA - ACCELERATING MODELS

Pruna — a Python framework for model optimization that speeds up inference and reduces resource usage without losing accuracy.

★ 1,391 · Python
Rizzo-AI-Academy/rizzo-pii

RIZZO PII: Document Anonymization

A local Python utility that removes personal data from files before sending them to an LLM. Protect your privacy without leaving your computer.

★ 1,271 · Python
NVIDIA/kvpress

KVPRESS: LLM CACHE COMPRESSION

Library for easy compression of LLM KV‑cache, accelerating generation and reducing GPU memory consumption.

★ 1,254 · Python
openvinotoolkit/nncf

NNCFF - ACCELERATING MODEL INFERENCE

NNCFF is a neural network compression framework for accelerated inference in OpenVINO™. It reduces model size while preserving accuracy.

★ 1,221 · Python
bodaay/HuggingFaceModelDownloader

DOWNLOAD HUGGINGFACE MODELS EASILY

Go utility for downloading models and datasets from HuggingFace. Supports CLI call and work via API, caches files locally.

★ 1,213 · Go
raiyanyahya/how-to-train-your-gpt

How to Train Your LLM

Build a modern LLM from scratch — every line of code is commented and explained simply, as if for a five-year-old.

★ 984 · Jupyter Notebook
zamalali/DeepGit

DEEPGIT: GITHUB HUNTER

DeepGit — a Python agent for finding the best GitHub repositories by topic. It uses LangChain and LangGraph to perform deep code and documentation analysis. Returns a sor

★ 929 · Python
whitecircle/halo

HALO: FRAMEWORK FOR LLM TRAINING

Halo is an open-source framework from White Circle for training large language and multimodal models. It supports agent-based training, async-RL, distributed training, an

★ 862 · Python
divagr18/qwenputer

RISC-V CPU COMPILED INTO QWEN3.5 WEIGHTS

Qwen3.5-4B with a 32-bit RISC-V CPU compiled directly into model weights. CPU uses Gated DeltaNet state as RAM and executes code inside model forward pass.

★ 814 · Python
zhongkaifu/TensorSharp

TENSORSHARP - POWERFUL .NET LLM

A library for quickly launching GGUF models on .NET with GPU support, console app, web chat, and an API compatible with Ollama and OpenAI.

★ 679 · C#
huggingface/optimum-intel

OPTIMUM-INTEL - ACCELERATE INFERENCE WITH INTEL

Optimum Intel provides Intel tools to accelerate AI model inference, simplifying deployment and boosting performance.

★ 630 · Jupyter Notebook
sunrainyg/RandOpt

RandOpt: Task Experts Optimization

Code for ICML 2026: diverse task experts are densest around pretrained weights.

★ 590 · Python
apocas/restai

OPEN-SOURCE AIaaS PLATFORM

RESTai — an AIaaS platform with Ollama/vLLM support, built-in image and audio generation, visual block programming, and analytics.

★ 520 · Python
YuvrajSingh-mist/Paper-Replications-and-Experiments

PYTORCH REPLICATIONS OF SOTA PAPERS

429 stars. From-scratch implementations of transformers, diffusion, GAN, CLIP, LoRA, MoE in Jupyter Notebook. Includes SFT and GRPO post-training experiments.

★ 430 · Jupyter Notebook
Epistates/pmetal

PMETAL: THE ACCEL LLM ON APPLE SILICON

PMetal — Rust framework for high‑performance LLM inference on Apple Silicon. Supports local inference, LoRA/QLoRA fine‑tuning, serving, quantization, and MLX/Metal accele

★ 333 · Rust
babycommando/neuralgraffiti

NEURALGRAFFITI: LIVE LLM OUTPUT CONTROL

NeuralGraffiti is a tool for live transformation of foundation model outputs directly at the neural network level. Works in real time without retraining.

★ 274 · Jupyter Notebook
Fazmin/AILearningGuide

Interactive AI Learning App

A TypeScript-based desktop application offering 51 hands‑on labs that teach ML basics, transformers, RAG, agents, fine‑tuning, and quantization.

★ 256 · TypeScript
ninjahawk/Subtext

SUBTEXT: BEHIND THE MODEL

A tool for analyzing hidden representations of AI models, revealing their internal logic.

★ 248 · HTML
Extraltodeus/J-Wash

J-WASH: LLM TOOL

Tool for manual alignment of large language models using Jacobian Lens, with results exported.

★ 242 · Python
Avarok-Cybersecurity/atlas

Inference Engine for Cybersecurity

High-performance inference engine in Rust with safe memory handling for cybersecurity tasks.

★ 240 · Rust
introfini/ZotSeek

ZOTSEEK AI SEARCH IN ZOTERO

ZotSeek adds semantic search to your Zotero library using vector embeddings. The built-in MCP server lets you connect Claude Code and Codex as AI agents for meaning‑based

★ 239 · TypeScript
Sudharsanselvaraj/Token-Print

TOKEN-PRINT 3D VISUALIZATION

Token-Print is an interactive platform for 3D visualization of transformer models, tensors, and real-time LLM inference. It supports loading models from Hugging Face and

★ 226 · TypeScript
wuwangzhang1216/abliterix

LLM Alignment Tuning

Automatic calibration of the language model's censorship layer via direct weight modification and the use of LoRA and MoE experts.

★ 221 · Python
jakobhoeg/browser-ai

AI IN BROWSER WITHOUT SERVER

Library of providers for Vercel AI SDK runs models directly in the browser. Simplifies client-side AI integration and unifies work across vendors. 205 stars on GitHub.

★ 207 · TypeScript
salikhussain71-code/PAKGOV-RAG-project

Bilingual Urdu-English Legal RAG

RAG system for Pakistani government and legal documents with Urdu-English OCR, hybrid retrieval, and citation grounding.

★ 130 · Python
MatthewK78/Rose

Rose — PyTorch Optimizer

Stateless PyTorch optimizer that normalizes gradients for stable and balanced model training.

★ 60 · Python
Greninja9257/LabLLM

LabLLM on macOS

LabLLM is a native macOS app where you can build the architecture of a tiny language model, train its weights, and see the model emerge from scratch on Apple Silicon usin

★ 39 · Swift
DaoyuanLi2816/can-i-finetune-this

Can I finetune this?

Tool to check whether a Hugging Face model fits in your GPU memory and can be fine-tuned locally.

★ 31 · Python

New projects on this topic in Telegram

Telegram →
Transformers — 50 open-source GitHub projects | REDDYX AI