Llama: open-source projects on GitHub
106 repositories on Llama, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
Ollama: Local LLMs
Run language models (Kimi‑K2.5, DeepSeek, Qwen, Gemma, etc.) locally on your device — simply and quickly.
★ 171,194 · GoHigh-performance LLM engine
A high-performance and memory-efficient engine for inference and serving large language models.
★ 79,783 · PythonLlamaFactory: Unified LLM Tuning
LlamaFactory offers a unified library for efficient fine‑tuning of 100+ LLMs and VLMs, with support for LoRA, QLoRA and distributed multi‑GPU training.
★ 71,186 · PythonWeb UI for Model Training
A simple web interface to train and run open language models (Gemma 4, Qwen3.6, DeepSeek, GPT‑OSS) locally, leveraging efficient fine‑tuning techniques.
★ 64,107 · PythonLocal AI Engine
LocalAI is an open-source engine for running any models (LLM, vision, voice, image, video) on any hardware without needing a GPU.
★ 46,221 · GoAider: AI programming in terminal
Aider is an AI assistant for pair programming in the terminal. It helps write, edit, and refactor code.
★ 44,686 · PythonAIRLLM: 70B Model on 4GB GPU
Running huge LLMs on weak hardware. AirLLM enables inference of 70B models on a single 4GB GPU.
★ 42,461 · Jupyter NotebookChatBot on LangChain
A local RAG application on LangChain for working with LLMs (ChatGLM, Qwen, Llama) with agent support and loading of custom knowledge.
★ 38,014 · PythonAstrBot – AI Assistant
A platform for creating AI agents that unites numerous messengers, LLMs, and plugins, providing an open alternative to OpenClaw.
★ 32,052 · PythonSGLang: LLM Framework
SGLang is a high-performance framework for serving large language and multimodal models.
★ 27,854 · PythonRepository Pack for AI
Tool packs the whole repository into a single file convenient for feeding into LLMs and other AI services.
★ 24,631 · TypeScriptFree LLM APIs
A list of free resources for accessing large language models via API.
★ 21,370 · PythonChatbot Interface
Graphical interface for working with ChatGPT API and other LLMs: support for agents, file Q&A, fine‑tuning and web search.
★ 15,339 · Pythonms-swift: LLM training
A framework for fine-tuning 600+ language and 300+ multimodal models. Supports PEFT, full fine-tuning, CPT/SFT/DPO/GRPO.
★ 14,178 · PythonOPENLLM: RUN LLMS AS OPENAI API
OpenLLM allows running any open-source LLMs (Llama, Qwen, DeepSeek) as OpenAI-compatible APIs with a single command. Includes chat UI, modern inference backends, and read
★ 12,607 · PythonSHELL_GPT - AI ASSISTANT FOR TERMINAL
Shell GPT is a command-line tool powered by GPT-5 that speeds up task execution and boosts work efficiency.
★ 12,312 · PythonLangChain4j for JVM
Java library for LLM applications: a unified API to providers and vector stores, tool calling, agents, RAG, and integration with Quarkus and Spring Boot.
★ 11,973 · JavaLUDWIG - LOW-CODE AI FRAMEWORK
Build LLMs and neural networks without code. Simplicity for custom AI models included!
★ 11,791 · PythonBISHENG — LLM DevOps Platform
An open platform for building next‑generation enterprise AI applications, featuring GenAI workflows, RAG, agents, and more.
★ 11,373 · TypeScriptTensorZero: LLMOps Platform
An open LLMOps platform that unifies LLM gateway, observability, evaluation, optimization, and experiments.
★ 11,366 · RustOUMI EASY LLM TUNING
OUMI lets you quickly fine‑tune (SFT/RL), evaluate, and deploy Qwen, Gemma, and any open agentic LLM/VLM without extra complexity.
★ 9,433 · PythonXINFERENCE - ANY LLM ONE LINE
Replace GPT with any open model by changing just one line of code. Run LLM, multimodal, and speech models via a single production-ready API.
★ 9,318 · PythonGENIEX: LLMs on Devices
Run cutting-edge multimodal models on GPU, NPU, and CPU — from PC to mobile and IoT devices.
★ 8,530 · RustGPTCache: SEMANTIC CACHE FOR LLM
GPTCache provides semantic caching of requests to large language models, reducing token consumption and speeding up responses. Fully integrated with LangChain and llama_i
★ 8,224 · PythonNEXA-SDK AI Everywhere Always
Run cutting‑edge LLMs and VLMs on GPU, NPU, and CPU — from PC to mobile and IoT devices. Support for models like GPT‑OSS, Granite‑4, Qwen‑3‑VL, and more.
★ 8,094 · RustLMDeploy: Easy LLM Deployment
A toolkit for compressing, deploying, and serving LLMs. ⭐ 7873 | Python
★ 7,873 · PythonK8SGPT: KUBERNETES ASSISTANT
k8sgpt uses AI to analyze Kubernetes clusters, identifying problems and offering instant fixes.
★ 7,846 · GoCOMBINE LLM MODELS EASILY
Mergekit offers tools to merge pretrained LLMs, combining weights, averages, and layers from different architectures like Llama. Output is a single model preserving the s
★ 7,452 · Pythonllm-scraper - LLM Web Scraping
Turn any web page into structured data using powerful LLMs – no parsing or regex needed.
★ 6,811 · TypeScriptENCHANTED - CHAT WITH OPEN MODELS
Enchanted — an iOS and macOS app that lets you chat with local Llama2, Mistral, and Vicuna models via Ollama.
★ 6,019 · SwiftHARNESS-SDK: CREATE AI AGENT FAST
A model-driven SDK lets you create AI agents in just a few lines of Python code.
★ 5,999 · PythonStrands Agents SDK
A model-based approach to creating AI agents in just a few lines of code.
★ 5,888 · PythonGPU cluster manager
Management of GPU clusters with automatic configuration and orchestration of inference engines (vLLM, SGLang) for high-performance deployment of AI models.
★ 5,041 · PythonH2O LLM Studio Launched Free
Framework for fine-tuning LLMs with a graphical interface. Configure language models without writing code!
★ 4,972 · PythonLLAMA-SWAP - RELIABLE MODEL REPLACEMENT
Utility for seamless model replacement on local servers (llama.cpp, vLLM, etc.)
★ 4,328 · GoLightLLM - Fast LLM Inference
A lightweight and fast framework for inference and serving of large language models in Python. Simple scaling and high performance.
★ 4,092 · PythonLemonade SDK
Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!
★ 4,059 · C++LANGRID - Multi-agent AI for Code
A simple framework for building LLM-based agents with memory and tool support.
★ 4,029 · PythonEagle: Next-Gen Visual AI
Eagle — cutting‑edge multimodal models in VLM format, developed using a Data‑Centric strategy. Over 2700 GitHub stars and actively evolving.
★ 3,857 · PythonLLAMASHARP - LOCAL LLM ON C#
A C#/.NET library for efficiently running LLaMA and LLaVA LLM models on a local device.
★ 3,826 · C#SIDEKICK: LOCAL AI CHAT
Sidekick — native macOS app for chatting with a local LLM, pulling answers from files, folders and web pages. Works fully offline on llama.cpp, no external APIs. Supports
★ 3,324 · SwiftAGiXT: AI Agent Automation
A platform for orchestrating AI agents with adaptive memory, plugins, and support for multiple AI providers.
★ 3,192 · PythonLlamaIndexTS framework
Framework for building server-side applications based on LLMs with easy data management.
★ 3,083 · TypeScriptMAID: MANAGE AI MODELS
Free tool for working with local and remote LLMs: llama.cpp, Anthropic, DeepSeek, etc.
★ 2,776 · TypeScriptPAPERSGPT — AI for Zotero
Powerful AI plugin for Zotero with support for ChatGPT, Gemini, Claude, DeepSeek and other models. 2459 stars!
★ 2,709 · JavaScriptXTRUING: PERSONALIZE YOUR LLM
xTuring simplifies creating and personalizing your own LLMs: from data preparation to fine‑tuning. The tool supports adapters, ready‑made pipelines and model export. Join
★ 2,681 · PythonOMAGENT: THE MULTIMODAL AGENT
OmAgent — Python framework for multimodal agents on Gemini, GPT-4 and other LLMs. Enables rapid prototyping and deployment via Gradio, supports RAG and rapid chatbot temp
★ 2,670 · PythonLocal Claude Code
Run Claude Code entirely on-device with Apple Silicon using an MLX-native server compatible with the Anthropic API. Supports local Qwen 3.5 122B, Llama 3.3 70B, and Gemma
★ 2,578 · PythonLLM Agent Framework in ComfyUI
Framework unites LLM agents, Omost, GPT‑Sovits, ChatTTS, and OCR in ComfyUI with support for Feishu, Discord, and all popular LLMs.
★ 2,390 · Pythonbeelzebub - AI-Driven Low-Code Virtualization
Beelzebub is a low-code framework for safely deceiving systems, using AI to virtualize environments.
★ 2,238 · GoLOCAL AI MODELS IN RUST
Instant and controllable pre-trained AI models running locally. 2205 stars — project gaining popularity.
★ 2,236 · RustRUN LLM LOCALLY IN NODE.JS
Run AI models directly on your computer via Node.js. Enforced JSON schema validation right at the generation level.
★ 2,205 · TypeScriptFAST LLM LAUNCH ON NPU
FastFlowLM runs LLMs on AMD Ryzen AI NPU in minutes, delivering performance comparable to Ollama but optimized for NPU.
★ 2,050 · C++LLAMA.VIM: LLM RIGHT IN VIM
A Vim plugin that adds code and text completion using large language models. 2000+ stars on GitHub.
★ 2,042 · Vim ScriptBEST LLM SKILLS COLLECTION
Curated list of skills and tools for AI agents working with Claude Code, Codex, and Gemini CLI.
★ 1,865 · PythonDETIKZIFY DRAWS LATEX DIAGRAMS FAST
DeTikZify turns textual descriptions or hand‑drawn sketches into ready‑to‑use TikZ code for LaTeX. The project leverages HuggingFace and Llama models for inverse graphics
★ 1,831 · PythonBUILD BOTS NO CODE
dialoqbase — a framework for quickly creating AI bots and RAG applications. Upload documents and chat with them.
★ 1,787 · TypeScriptFAST MULTIMODAL LLM ON MOBILE
A C++ library enables running multimodal LLMs directly on smartphones with high speed and low power consumption.
★ 1,533 · C++tt-metal - Metallic Operations Library
TT-NN operator library and low-level programming model for TT-Metalium kernels to accelerate AI workloads on proprietary hardware.
★ 1,505 · C++RISUAI: CREATE YOUR STORIES
Risuai lets you easily create interactive role-playing plots with LLM using TypeScript.
★ 1,491 · TypeScriptNew projects on this topic in Telegram
Telegram →