LLM: open-source projects on GitHub
2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
MisakaNet: AI Agent Library
Python micro-lessons library for AI agents: exchange proven debugging experience via git. No dependencies, stdlib only.
★ 561 · PythonPAXML - AMAZING JAX FRAMEWORK
Pax is a JAX framework for training large-scale models with high FLOP utilization and flexible parallelization.
★ 561 · PythonLLM-API-KEY-PROXY - UNIVERSAL LLM GATEWAY
A unified API for accessing any LLM with OpenAI/Anthropic compatibility, load balancing, and request translation.
★ 561 · PythonAGENTIC AI LANDSCAPE - AGENT MAP
Data and insights on agentic AI systems from Ant Open Source and inclusionAI. 499 stars on GitHub!
★ 560 · TypeScriptAUTOLITH — SELF‑MODIFYING AI AGENT
Autolith — self‑rewriting AI agent in Common Lisp, changing its code at runtime. It interacts with LLM via API, generates and improves programs, works as a CLI agent and
★ 560 · Common LispAwesome LLM Resources List
A curated list of the best articles, tutorials, and tools for hands-on work with large language models.
★ 559 · PythonDEER-WORKFLOW — GRAPH WORKFLOW IN TYPESCRIPT
Open runtime for graph engineering: orchestration in TypeScript, with semantic work delegated to replaceable Agent runtimes.
★ 558 · TypeScriptYOUR AI AGENTS IN MESSENGERS
abacusai-bot — 100% free open-source framework for running personal AI agents in Telegram, WhatsApp, and CLI. Written in TypeScript, supports tools, code, and integration
★ 557 · TypeScriptYOUR TEAM OF AI BOTS IN ONE BINARY
Self-hosted solution for AI agent team: spaces, all accounts in one place, task handoffs, approvals and routines. Written in Rust + React. Alternative to Grok Bot, Claude
★ 556 · RustVSCODE EXTENSION WITH LLM
Connect Claude, Gemini, ChatGPT and other LLMs to GitHub Copilot Chat VS Code via plugin. Quick setup and free models!
★ 552 · TypeScriptKOHAKUTERRARIUM AGENT FRAMEWORK
KohakuTerrarium is a framework for creating autonomous AI agents and teams with built-in tools, TUI, and a web interface.
★ 551 · PythonWDOC - SMART DOCUMENT SEARCH
Summarization and search across heterogeneous documents with support for any LLM providers, file types, and advanced RAG.
★ 550 · PythonTALWELL: LONG-TERM MEMORY
TALWELL — plugin‑oriented long-term memory for AI‑agent platforms, implementation of the AMP protocol. Written in JavaScript, it has 549 ★ and supports auto‑dream and LLM
★ 550 · JavaScriptASKIMO: AI CHAT CLIENT
askimo is a universal AI client in Kotlin with support for chat, RAG, plans, and agents through multiple model providers.
★ 549 · KotlinECHO: AI Where the User Pays
SDK where AI costs fall on the user, not the developer.
★ 548 · TypeScriptMOBIUS: RUST FRAMEWORK FOR AGENTS
Möbius is a compact Rust framework for building code-writing agents. Frontend-agnostic and works with any LLM. Already gained 300 GitHub stars.
★ 547 · RustSECURE SANDBOX FOR AI AGENTS
Box isolates AI agents, using OS isolation and default‑deny Dogwood policies. It injects credentials from a secure store without exposing them to the agent, and restricts
★ 546 · RustSurvive LLM Chaos
Open-source Go tool for fine-tuning, building, and deploying LLMs with a single command.
★ 545 · GoREMOVES ADS BEFORE PLAYBACK
MinusPod — a self-hosted Python server that intercepts media streams and removes ads before playback using LLM Claude. Users get clean content without interruptions, with
★ 545 · PythonAWS CDK FOR GENERATIVE AI
AWS CDK construct library for building generative AI solutions. Ready-made patterns for quick start.
★ 544 · TypeScript230+ SEMANTIC ANCHORS
Catalog of 230+ verified terms like arc42, TDD London School, tracer bullet. Activate deep LLM knowledge. Insert into prompts and agent instructions instead of manual met
★ 541 · HTMLR2AI: AI REVERSING
r2ai — plugin for radare2 that uses LLM for automatic analysis and reversing of code. Integrates directly into the radare2 interface, providing hints and generating pseud
★ 540 · CDISLLM INFERENCE ON MOJO
Runs diffusion LLMs (LLaDA, Dream) locally on CPU without GPU. Written in Mojo with GGUF format support. 289 stars on GitHub.
★ 540 · MojoAI AGENT FOR PENTESTING
Mitsu (EVA) — AI agent for pentesting, automating attacks via structured scenarios and contextual analysis. Supports multiple LLM backends and runs in CLI. 534 stars on G
★ 539 · PythonDOCUMENTATION INTO TESTS AUTOMATIC
Truecourse automatically turns documentation into executable tests. When a test fails, it pinpoints the exact docs section where the product differs from the description,
★ 538 · TypeScriptMEMT-1.0: LONG-TERM MEMORY FOR LLM
Official MemT-1.0 repository. Implements long-term memory for LLM agents. Supports long context and DeepSeek integration.
★ 537 · PythonFUD AI: Calorie Tracker
Free open-source calorie tracker with AI nutrition analysis for iOS and Android.
★ 536 · KotlinWHISPLA AI CHATBOT ON RPI
A compact AI chatbot on Raspberry Pi Zero 2W, written in TypeScript. Easy to deploy and chat with LLM.
★ 536 · TypeScriptVECTORHUB - DEPRECATED REPOSITORY FOR EMBEDDINGS
The archived VectorHub project showcases early work on vector search. The team is now focused on SIE — a self-hosted engine for embeddings, ranking, and document processi
★ 535 · Jupyter NotebookLOCAL AI WITHOUT CLOUD
Hob — open-source desktop client running Gemma and gpt-oss locally on Mac, Windows, and Linux. Works fully offline, no data leaves your machine. Free alternative to Claud
★ 535 · TypeScriptUNIVERSAL SDK FOR MCP SERVERS
Concierge — a universal SDK for building modern MCP servers in Python. 534 stars on GitHub!
★ 534 · PythonOPEN SCIENTIFIC WORK WITH AI
OpenDraft — free open-source tool: 19 AI agents write an article up to 20,000 words in about 10 minutes with verified references. Export to PDF, Word, LaTeX.
★ 534 · PythonPREMIERE-PRO-MCP - AI VIDEO EDITOR
The MCP server for Premiere Pro combines 280 AI tools, a CEP bridge, and UXP support for smart video editing.
★ 533 · TypeScriptAUTO-BROWSER - AI GETS REAL BROWSER
Open-source Python agent: gives AI access to a real browser with human control via MCP.
★ 532 · PythonREQ_LLM Elixir for LLM
A composable Elixir library for working with LLM, built on Req and Finch. Allows easy integration of models into your code.
★ 532 · ElixirEPISODIC AGENT MEMORY
Records the screen locally, builds structured activity frames, and serves them via MCP — without cloud or LLM in the chain.
★ 532 · PythonTALK WITH ANY ARXIV PAPER
Project talk2arxiv lets you chat with any arXiv article using ChatGPT's power. Via a RAG approach it quickly finds relevant passages and answers with citations. Source co
★ 532 · TypeScriptAI PERSONALIZED EXAM SYSTEM
🧠 Adaptive system for generating exam questions based on LLM, knowledge graph, and BKT algorithm.
★ 531 · PythonOPENCODE SWARM: AGENT SWARM
Plugin for OpenCode implementing hub-and-spoke orchestration of an agent swarm with SME consultation, code generation, and QA review.
★ 531 · TypeScriptFIRE RED ASR2S SOTA RECOGNITION
Full-featured industrial ASR system with speech recognition, VAD, LID, and punctuation, supporting Chinese, English, code-switching, and singing.
★ 528 · PythonVLA MODELS FOR CARS
A collection of Vision-Language-Action models for autonomous driving: an overview of past, present, and future directions.
★ 527 · HTMLLLM Serving in Kubernetes
OME is an operator for running LLMs in Kubernetes with smart GPU scheduling and support for SGLang, vLLM, TensorRT-LLM, and Triton.
★ 527 · GoModelScope Developer Handbook
A hands‑on guide for developers to select, run, fine‑tune, evaluate, and deploy open‑source models, covering RAG, agents, and AIGC from first run to production.
★ 526 · HTMLPROMETHEUS MCP SERVER FOR AI
An MCP server enabling AI agents and LLMs to query and analyze Prometheus metrics through a standard interface.
★ 525 · PythonLyrie.ai — Autonomous AI Cybersecurity Agent
Lyrie.ai — the world's first autonomous AI agent for cybersecurity by OTT Cybersecurity LLC.
★ 524 · TypeScriptXYBRID: On-Device AI
xybrid — framework for creating applications with on‑device AI in Rust.
★ 524 · RustNUDGEBEE: AI IN CLOUDOPS
Unified CloudOps platform with AI‑SRE, AI‑FinOps, and AI‑K8sOps, plus an agentic automation builder — no fragmentation and no model lock‑in.
★ 524 · GoDreamServer: Local AI
DreamServer is an open-source project for running LLMs locally with a chat interface, voice control, agents, workflows, RAG, and image generation, operating without cloud
★ 523 · PythonAWESOME-RAG: RESOURCE LIBRARY
A curated collection of resources on Retrieval-Augmented Generation for LLMs. Perfect for developers working with RAG technologies.
★ 521OPEN-SOURCE AIaaS PLATFORM
RESTai — an AIaaS platform with Ollama/vLLM support, built-in image and audio generation, visual block programming, and analytics.
★ 520 · PythonAI Surveys on Steroids
edsl — a framework for creating AI surveys and experiments with thousands of AI agents. Ideal for social sciences and marketing.
★ 519 · PythonLOCAL AI UNCENSORED
Desktop app with chat, agent, image and video generation. One .exe, no Docker. 518 ⭐
★ 518 · TypeScriptgitagent - Universal AI Agent
Framework for creating AI agents that live inside a git repository: rules, memory, and tools are stored as files under version control.
★ 518 · TypeScriptUNITING AI AGENTS IN THE TERMINAL
Runner unites Claude Code, Codex, GitHub Copilot CLI and pi in one terminal, giving each agent its own TUI while working on a shared task. Written in Rust, the project ha
★ 518 · RustORCA: DEEPSEEK-NATIVE CODING AGENT
Native DeepSeek agent in Rust for coding automation. Manages files, runs commands, and solves tasks in the terminal without extra abstractions.
★ 516 · RustMEMTRACE: MEMORY FOR AI AGENTS
Structural memory for AI coding agents with a bi‑temporal graph, MCP‑native integration and zero LLM calls. Works in Cursor, Claude Code, VS Code and more.
★ 515 · PythonCORTEXDB: AI MEMORY FILE
A full-featured pure Go library for storing knowledge graphs and AI memory in a single file.
★ 514 · GoOPENGROK: MODEL MANAGEMENT
Run any model in Grok Bot with one command. Model selection UI and provider map with evidence‑based base. Update‑proof doctor guards against breakages on updates.
★ 514 · JavaScriptOPEN-PROMPT-INJECTION
Open-Prompt-Injection — benchmark for evaluating attack and defense against prompt injections in LLMs. Contains datasets,test scripts,defense metrics. Implemented in Pyth
★ 514 · PythonWhirl AI Chat Platform
Whirl is a TypeScript‑based AI chat application that integrates top language models, persistent memory, live document editing, and custom tool usage.
★ 514 · TypeScriptNew projects on this topic in Telegram
Telegram →