R_REDDYX.XYZ

Llama: open-source projects on GitHub

106 repositories on Llama, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Openai 690GPT 153Ollama 249Mistral 40Deepseek 229Qwen 106Chatgpt 314Anthropic 452Chatbot 168Gemini 348MCP 1601Llama3 28Claude 978
ollama/ollama

Ollama: Local LLMs

Run language models (Kimi‑K2.5, DeepSeek, Qwen, Gemma, etc.) locally on your device — simply and quickly.

★ 171,194 · Go
vllm-project/vllm

High-performance LLM engine

A high-performance and memory-efficient engine for inference and serving large language models.

★ 79,783 · Python
hiyouga/LlamaFactory

LlamaFactory: Unified LLM Tuning

LlamaFactory offers a unified library for efficient fine‑tuning of 100+ LLMs and VLMs, with support for LoRA, QLoRA and distributed multi‑GPU training.

★ 71,186 · Python
unslothai/unsloth

Web UI for Model Training

A simple web interface to train and run open language models (Gemma 4, Qwen3.6, DeepSeek, GPT‑OSS) locally, leveraging efficient fine‑tuning techniques.

★ 64,107 · Python
mudler/LocalAI

Local AI Engine

LocalAI is an open-source engine for running any models (LLM, vision, voice, image, video) on any hardware without needing a GPU.

★ 46,221 · Go
Aider-AI/aider

Aider: AI programming in terminal

Aider is an AI assistant for pair programming in the terminal. It helps write, edit, and refactor code.

★ 44,686 · Python
lyogavin/airllm

AIRLLM: 70B Model on 4GB GPU

Running huge LLMs on weak hardware. AirLLM enables inference of 70B models on a single 4GB GPU.

★ 42,461 · Jupyter Notebook
chatchat-space/Langchain-Chatchat

ChatBot on LangChain

A local RAG application on LangChain for working with LLMs (ChatGLM, Qwen, Llama) with agent support and loading of custom knowledge.

★ 38,014 · Python
AstrBotDevs/AstrBot

AstrBot – AI Assistant

A platform for creating AI agents that unites numerous messengers, LLMs, and plugins, providing an open alternative to OpenClaw.

★ 32,052 · Python
sgl-project/sglang

SGLang: LLM Framework

SGLang is a high-performance framework for serving large language and multimodal models.

★ 27,854 · Python
yamadashy/repomix

Repository Pack for AI

Tool packs the whole repository into a single file convenient for feeding into LLMs and other AI services.

★ 24,631 · TypeScript
cheahjs/free-llm-api-resources

Free LLM APIs

A list of free resources for accessing large language models via API.

★ 21,370 · Python
GaiZhenbiao/ChuanhuChatGPT

Chatbot Interface

Graphical interface for working with ChatGPT API and other LLMs: support for agents, file Q&A, fine‑tuning and web search.

★ 15,339 · Python
modelscope/ms-swift

ms-swift: LLM training

A framework for fine-tuning 600+ language and 300+ multimodal models. Supports PEFT, full fine-tuning, CPT/SFT/DPO/GRPO.

★ 14,178 · Python
bentoml/OpenLLM

OPENLLM: RUN LLMS AS OPENAI API

OpenLLM allows running any open-source LLMs (Llama, Qwen, DeepSeek) as OpenAI-compatible APIs with a single command. Includes chat UI, modern inference backends, and read

★ 12,607 · Python
TheR1D/shell_gpt

SHELL_GPT - AI ASSISTANT FOR TERMINAL

Shell GPT is a command-line tool powered by GPT-5 that speeds up task execution and boosts work efficiency.

★ 12,312 · Python
langchain4j/langchain4j

LangChain4j for JVM

Java library for LLM applications: a unified API to providers and vector stores, tool calling, agents, RAG, and integration with Quarkus and Spring Boot.

★ 11,973 · Java
ludwig-ai/ludwig

LUDWIG - LOW-CODE AI FRAMEWORK

Build LLMs and neural networks without code. Simplicity for custom AI models included!

★ 11,791 · Python
dataelement/bisheng

BISHENG — LLM DevOps Platform

An open platform for building next‑generation enterprise AI applications, featuring GenAI workflows, RAG, agents, and more.

★ 11,373 · TypeScript
tensorzero/tensorzero

TensorZero: LLMOps Platform

An open LLMOps platform that unifies LLM gateway, observability, evaluation, optimization, and experiments.

★ 11,366 · Rust
oumi-ai/oumi

OUMI EASY LLM TUNING

OUMI lets you quickly fine‑tune (SFT/RL), evaluate, and deploy Qwen, Gemma, and any open agentic LLM/VLM without extra complexity.

★ 9,433 · Python
xorbitsai/inference

XINFERENCE - ANY LLM ONE LINE

Replace GPT with any open model by changing just one line of code. Run LLM, multimodal, and speech models via a single production-ready API.

★ 9,318 · Python
qualcomm/GenieX

GENIEX: LLMs on Devices

Run cutting-edge multimodal models on GPU, NPU, and CPU — from PC to mobile and IoT devices.

★ 8,530 · Rust
zilliztech/GPTCache

GPTCache: SEMANTIC CACHE FOR LLM

GPTCache provides semantic caching of requests to large language models, reducing token consumption and speeding up responses. Fully integrated with LangChain and llama_i

★ 8,224 · Python
qualcomm/nexa-sdk

NEXA-SDK AI Everywhere Always

Run cutting‑edge LLMs and VLMs on GPU, NPU, and CPU — from PC to mobile and IoT devices. Support for models like GPT‑OSS, Granite‑4, Qwen‑3‑VL, and more.

★ 8,094 · Rust
InternLM/lmdeploy

LMDeploy: Easy LLM Deployment

A toolkit for compressing, deploying, and serving LLMs. ⭐ 7873 | Python

★ 7,873 · Python
k8sgpt-ai/k8sgpt

K8SGPT: KUBERNETES ASSISTANT

k8sgpt uses AI to analyze Kubernetes clusters, identifying problems and offering instant fixes.

★ 7,846 · Go
arcee-ai/mergekit

COMBINE LLM MODELS EASILY

Mergekit offers tools to merge pretrained LLMs, combining weights, averages, and layers from different architectures like Llama. Output is a single model preserving the s

★ 7,452 · Python
mishushakov/llm-scraper

llm-scraper - LLM Web Scraping

Turn any web page into structured data using powerful LLMs – no parsing or regex needed.

★ 6,811 · TypeScript
gluonfield/enchanted

ENCHANTED - CHAT WITH OPEN MODELS

Enchanted — an iOS and macOS app that lets you chat with local Llama2, Mistral, and Vicuna models via Ollama.

★ 6,019 · Swift
strands-agents/harness-sdk

HARNESS-SDK: CREATE AI AGENT FAST

A model-driven SDK lets you create AI agents in just a few lines of Python code.

★ 5,999 · Python
strands-agents/sdk-python

Strands Agents SDK

A model-based approach to creating AI agents in just a few lines of code.

★ 5,888 · Python
gpustack/gpustack

GPU cluster manager

Management of GPU clusters with automatic configuration and orchestration of inference engines (vLLM, SGLang) for high-performance deployment of AI models.

★ 5,041 · Python
h2oai/h2o-llmstudio

H2O LLM Studio Launched Free

Framework for fine-tuning LLMs with a graphical interface. Configure language models without writing code!

★ 4,972 · Python
mostlygeek/llama-swap

LLAMA-SWAP - RELIABLE MODEL REPLACEMENT

Utility for seamless model replacement on local servers (llama.cpp, vLLM, etc.)

★ 4,328 · Go
ModelTC/LightLLM

LightLLM - Fast LLM Inference

A lightweight and fast framework for inference and serving of large language models in Python. Simple scaling and high performance.

★ 4,092 · Python
lemonade-sdk/lemonade

Lemonade SDK

Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!

★ 4,059 · C++
langroid/langroid

LANGRID - Multi-agent AI for Code

A simple framework for building LLM-based agents with memory and tool support.

★ 4,029 · Python
NVlabs/Eagle

Eagle: Next-Gen Visual AI

Eagle — cutting‑edge multimodal models in VLM format, developed using a Data‑Centric strategy. Over 2700 GitHub stars and actively evolving.

★ 3,857 · Python
SciSharp/LLamaSharp

LLAMASHARP - LOCAL LLM ON C#

A C#/.NET library for efficiently running LLaMA and LLaVA LLM models on a local device.

★ 3,826 · C#
johnbean393/Sidekick

SIDEKICK: LOCAL AI CHAT

Sidekick — native macOS app for chatting with a local LLM, pulling answers from files, folders and web pages. Works fully offline on llama.cpp, no external APIs. Supports

★ 3,324 · Swift
Josh-XT/AGiXT

AGiXT: AI Agent Automation

A platform for orchestrating AI agents with adaptive memory, plugins, and support for multiple AI providers.

★ 3,192 · Python
run-llama/LlamaIndexTS

LlamaIndexTS framework

Framework for building server-side applications based on LLMs with easy data management.

★ 3,083 · TypeScript
Mobile-Artificial-Intelligence/maid

MAID: MANAGE AI MODELS

Free tool for working with local and remote LLMs: llama.cpp, Anthropic, DeepSeek, etc.

★ 2,776 · TypeScript
papersgpt/papersgpt-for-zotero

PAPERSGPT — AI for Zotero

Powerful AI plugin for Zotero with support for ChatGPT, Gemini, Claude, DeepSeek and other models. 2459 stars!

★ 2,709 · JavaScript
stochasticai/xTuring

XTRUING: PERSONALIZE YOUR LLM

xTuring simplifies creating and personalizing your own LLMs: from data preparation to fine‑tuning. The tool supports adapters, ready‑made pipelines and model export. Join

★ 2,681 · Python
om-ai-lab/OmAgent

OMAGENT: THE MULTIMODAL AGENT

OmAgent — Python framework for multimodal agents on Gemini, GPT-4 and other LLMs. Enables rapid prototyping and deployment via Gradio, supports RAG and rapid chatbot temp

★ 2,670 · Python
nicedreamzapp/claude-code-local

Local Claude Code

Run Claude Code entirely on-device with Apple Silicon using an MLX-native server compatible with the Anthropic API. Supports local Qwen 3.5 122B, Llama 3.3 70B, and Gemma

★ 2,578 · Python
heshengtao/comfyui_LLM_party

LLM Agent Framework in ComfyUI

Framework unites LLM agents, Omost, GPT‑Sovits, ChatTTS, and OCR in ComfyUI with support for Feishu, Discord, and all popular LLMs.

★ 2,390 · Python
beelzebub-labs/beelzebub

beelzebub - AI-Driven Low-Code Virtualization

Beelzebub is a low-code framework for safely deceiving systems, using AI to virtualize environments.

★ 2,238 · Go
floneum/kalosm

LOCAL AI MODELS IN RUST

Instant and controllable pre-trained AI models running locally. 2205 stars — project gaining popularity.

★ 2,236 · Rust
withcatai/node-llama-cpp

RUN LLM LOCALLY IN NODE.JS

Run AI models directly on your computer via Node.js. Enforced JSON schema validation right at the generation level.

★ 2,205 · TypeScript
ROCm/FastFlowLM

FAST LLM LAUNCH ON NPU

FastFlowLM runs LLMs on AMD Ryzen AI NPU in minutes, delivering performance comparable to Ollama but optimized for NPU.

★ 2,050 · C++
ggml-org/llama.vim

LLAMA.VIM: LLM RIGHT IN VIM

A Vim plugin that adds code and text completion using large language models. 2000+ stars on GitHub.

★ 2,042 · Vim Script
Prat011/awesome-llm-skills

BEST LLM SKILLS COLLECTION

Curated list of skills and tools for AI agents working with Claude Code, Codex, and Gemini CLI.

★ 1,865 · Python
potamides/DeTikZify

DETIKZIFY DRAWS LATEX DIAGRAMS FAST

DeTikZify turns textual descriptions or hand‑drawn sketches into ready‑to‑use TikZ code for LaTeX. The project leverages HuggingFace and Llama models for inverse graphics

★ 1,831 · Python
n4ze3m/dialoqbase

BUILD BOTS NO CODE

dialoqbase — a framework for quickly creating AI bots and RAG applications. Upload documents and chat with them.

★ 1,787 · TypeScript
UbiquitousLearning/mllm

FAST MULTIMODAL LLM ON MOBILE

A C++ library enables running multimodal LLMs directly on smartphones with high speed and low power consumption.

★ 1,533 · C++
tenstorrent/tt-metal

tt-metal - Metallic Operations Library

TT-NN operator library and low-level programming model for TT-Metalium kernels to accelerate AI workloads on proprietary hardware.

★ 1,505 · C++
kwaroran/Risuai

RISUAI: CREATE YOUR STORIES

Risuai lets you easily create interactive role-playing plots with LLM using TypeScript.

★ 1,491 · TypeScript

New projects on this topic in Telegram

Telegram →
Llama — 106 open-source GitHub projects | REDDYX AI