LLM: open-source projects on GitHub
2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
PGAI: AI INSIDE POSTGRESQL
A toolkit for building RAG, semantic search, and AI applications directly in PostgreSQL. 5801 ⭐
★ 5,801 · PLpgSQLKLAVIS AI: MCP Agent Platform
Integration of tools for AI agents — a reliable and scalable MCP. 5746 ⭐ Python
★ 5,746 · Pythontiny-llm - BUILD MINI LLM M1
Course on deploying LLM on Apple Silicon: build your own tiny vLLM + Qwen in just minutes.
★ 5,744 · PythonholaOS AI Automation
holaOS turns routine tasks into autonomous AI flows, automating repetitive work.
★ 5,651 · TypeScriptZENML: AI PLATFORM FROM PIPELINE
ZenML is a Python framework for creating AI pipelines and agents, unifying data, models, and orchestration in a single platform.
★ 5,636 · PythonUltraRAG: RAG pipeline framework
Low-code MCP framework for creating complex and innovative RAG pipelines.
★ 5,549 · PythonLM STUDIO CLI: MANAGE MODELS
Command line for quickly launching and managing local LLMs in LM Studio. Simplifies working with models without a GUI.
★ 5,430 · TypeScriptMOONCAKE - KIMI LLM PLATFORM, 5400+ STARS
Mooncake is the backend platform for Kimi from Moonshot AI. High-performance open-source LLM service in C++.
★ 5,429 · C++GISKARD-OSS - LLM AGENT EVALUATION
Library for evaluating and testing LLM agents with open-source code.
★ 5,417 · PythonRAG FOR MONOREPOS
AI tool for understanding and editing multilingual codebases through knowledge graphs. 2274 ⭐
★ 5,354 · PythonEDIT-BANANA: STATISTICS NOW EDITABLE
Framework for converting statistical formats into editable ones. 5300 stars on GitHub!
★ 5,300 · PythonMCP-UI: FUTURE UI DEVELOPMENT
Create modern interfaces using the MCP protocol and TypeScript SDK. Easily integrate AI agents and get flexible UI solutions.
★ 5,262 · TypeScriptPPTAgent: AI CREATES PRESENTATIONS
A Python-based agent framework for automatic generation of PowerPoint presentations with a reflective approach.
★ 5,247 · PythonClaude + Obsidian Wiki
Persistent wiki repository with AI based on Claude and Obsidian. Automated research, saving, and an accumulating knowledge base following the Karpathy pattern.
★ 5,246 · PythonEASYR1: MULTIMODAL RL TRAINING
EasyR1 is a scalable framework for multimodal reinforcement learning training on veRL, delivering high efficiency and ease of use.
★ 5,215 · PythonARGILLA - CREATE DATASETS FASTER
Argilla helps AI engineers and domain experts collaboratively create high-quality datasets for training models.
★ 5,203 · PythonHuman-in-the-Loop Adapter for OpenOPC
Enables zero-modification human intervention in OpenOPC's agentic DAG runtime. Lets operators pause, inspect, and redirect agent workflows without code changes.
★ 5,186 · PythonAUTONOMOUS AI DESKTOP COMPANION
An autonomous AI assistant living on your desktop. Observes the screen, tracks the active window, and proactively interacts via voice and an animated interface.
★ 5,178 · PythonSmart Agents with RL
AReaL — a bridge between reinforcement learning and LLM agents. Simple and flexible.
★ 5,177 · PythonASTRON RPA: Ready Agent
A ready-to-use RPA toolkit in Java: quickly create agents for automating business processes. Suitable for individual and corporate teams.
★ 5,173 · JavaSPARROW: POWERFUL DATA EXTRACTION
Sparrow extracts structured data, executes instructions, and builds agent workflows based on ML, LLM, and Vision LLM.
★ 5,160 · PythonOPENAGENT: AI ASSISTANT OF THE FUTURE
openagent – the next level of personal AI assistant: LLM, RAG, and agent loops for computer, browser, and code work.
★ 5,150 · GoDossier Resume Builder
Self-hosted web app that generates customized resumes and cover letters from your professional profile.
★ 5,145 · TypeScriptXTUNER: TRAINER FOR LARGE MoE
A Next-Generation Training Engine Built for Ultra-Large MoE Models. ⭐ 5138 stars on GitHub!
★ 5,138 · PythonJSON_REPAIR - FIX JSON INSTANTLY
The json_repair library automatically fixes corrupted JSON obtained from LLM, API, logs, and user input, saving developers' time.
★ 5,135 · PythonTEXT-EMBEDDINGS-INFERENCE - Instant Embedding Inference
Fast inference for text embedding models in Rust, providing low latency and high throughput.
★ 5,122 · RustGateway for corporate AI
The fastest AI gateway: 50x faster than LiteLLM, support for 1000+ models, load balancing, cluster mode, limits and overhead under 100 µs at 5k RPS.
★ 5,089 · GoGPU cluster manager
Management of GPU clusters with automatic configuration and orchestration of inference engines (vLLM, SGLang) for high-performance deployment of AI models.
★ 5,041 · PythonZEP: Examples and Integrations
Python project Zep — examples, integrations, and useful materials. Almost 4,700 stars on GitHub!
★ 5,007 · PythonEverOS: Long-Term AI Memory
Platform for creating, evaluating, and integrating long-term memory in autonomous AI agents with self-evolution capability.
★ 4,973 · PythonH2O LLM Studio Launched Free
Framework for fine-tuning LLMs with a graphical interface. Configure language models without writing code!
★ 4,972 · PythonESP32 iPhone AI Agent
Use a cheap ESP32 to give an AI vision model real iPhone screen via AirPlay and control via USB HID, enabling hands‑free interaction without Mac or jailbreak.
★ 4,956 · PythonEfficient AI for Mobile Devices
An AI engine with minimal latency for smartphones and wearable devices.
★ 4,949 · CKiroCrew Development Environment
KiroCrew is a persistent development environment that self‑learns and retains progress between development sessions.
★ 4,947 · PythonMaiBot — living AI girlfriend
MaiSaka — a smart agent based on LLM, created for warm, sincere communication. She doesn’t chase ideals — she values genuine interaction over productivity.
★ 4,946 · PythonAGENTOS AI Agent OS
agentOS — a portable open-source OS for agents: cold start ~6 ms, 32× cheaper than WebAssembly sandboxes.
★ 4,900 · TypeScriptMOCKSERVER - MOCK HTTP AND HTTPS
MockServer for mocking API with support for Java, JS, and Ruby. Proxy decrypts SSL and supports port forwarding for full control.
★ 4,888 · JavaOPEN PLATFORM FOR LANGUAGE AGENTS
OpenAgents is an open platform for running language agents in real-world tasks. Supports code generation, web navigation, and tool use. Ready for production deployment.
★ 4,866 · PythonMAGICREW — AI Platform of Future
First open-source platform with an AI agent, workflow engine, messenger, and collaborative office. 4850 stars on GitHub!
★ 4,850 · TypeScriptAI EDITOR WITH SMART WIKI
Beautiful markdown editor with AI support and built-in wiki system to make LLM models smarter.
★ 4,849 · TypeScriptAutoRAG: RAG System Automation
An open-source framework for automatic evaluation and optimization of RAG pipelines in an AutoML style.
★ 4,804 · PythonLOLMS-WEBUI — MODULAR LLM INTERFACE
Web interface for managing large language and multimodal models via an intuitive UI. Supports chat, code generation, and image work.
★ 4,793 · PythonMLX-VLM: RUN VLM ON MAC
Package for running and fine‑tuning Vision Language Models on Mac via MLX. 4.7K★
★ 4,787 · PythonAI Agents Management Platform
Self-hosted platform for orchestrating AI agents: send tasks, launch multi-agent workflows, monitor costs, and manage operations through a unified dashboard.
★ 4,765 · TypeScriptGuide to AI Agents
Practical guide to creating AI agents: LangGraph, advanced RAG, interview preparation and data synthesis.
★ 4,747 · HTMLHermes Agent Dashboard
Hermes Agent web dashboard: chat, sessions, tasks, and analytics.
★ 4,731 · TypeScriptLLPlayer - LANGUAGE LEARNING
Media player for language learning with dual subtitles, AI subtitles, and real‑time translation.
★ 4,725 · C#DISCOVER HARNESSES: TOOLS
A collection of the best tutorials and utilities for working with wire harnesses and power systems.
★ 4,722AI COOKBOOK FOR DEVELOPERS
Collection of examples and tutorials in Python for building AI systems: from simple scripts to advanced agents.
★ 4,711 · PythonAG2: Open-Source Agent OS
AG2 (formerly AutoGen) — an open-source agent operating system for building intelligent AI agents.
★ 4,597 · PythonHONCHO: Memory for Agents
A Python memory library for building stateful AI agents, enabling storage and retrieval of context.
★ 4,592 · PythonAI agent for integrations
The first AI agent that creates permission‑independent integrations by reverse‑engineering the internal APIs of platforms.
★ 4,588 · PythonMEMORY FOR LLM APPS
LongMemory — local persistent memory store for LLM applications (Claude Desktop, GitHub Copilot, Codex, Antigravity). Fast search, context retention, and synchronization
★ 4,579 · TypeScriptTENCENTDB AGENT MEMORY: AI MEMORY
Local long-term memory for AI agents without external APIs. A four-level pipeline in TypeScript provides instant access to knowledge.
★ 4,573 · TypeScriptNexent: AI Agent Platform
Nexent is a no-code platform for automatically generating enterprise‑grade AI agents using Harness Engineering principles.
★ 4,535 · PythonVLMEvalKit - TOP TOOL FOR MODEL EVALUATION
Open tool for evaluating multimodal models. Supports 220+ LMM and 80+ benchmarks.
★ 4,492 · PythonEmdash: Agent Development Environment
Emdash — an open‑source agent development environment. Run many agents in parallel with any provider.
★ 4,442 · TypeScriptTerminal AI Agent
AI agent for the terminal with hash-pinned edits, an optimized toolset, LSP, Python, browser, sub-agents, and much more.
★ 4,427 · TypeScriptMCP‑SERVER CHART: 25+ CHARTS ON ANTV
mcp‑server-chart — set of 25+ AntV visualizations for chart generation and data analysis. Integrates with the MCP server, letting LLMs create diagrams from natural prompt
★ 4,419 · TypeScriptUNLAZY: FIGHTING AI LAZINESS
The Depth Tree method splits the task into N layers, giving each leaf the full time budget — effort grows with depth.
★ 4,403 · JavaScriptNew projects on this topic in Telegram
Telegram →