LLM: open-source projects on GitHub
2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
AWESOME AI SDKS – COLLECTION
A database of SDKs, frameworks, and tools for building, debugging, and deploying autonomous AI agents. It simplifies selection and speeds up development.
★ 1,241DARK-MOON Autonomous AI Pentest
Autonomous AI engine for continuous pentesting of web, cloud, AD, and Kubernetes with real vulnerability exploitation.
★ 1,238 · PythonGRAPHGEN: DATA SYNTHESIS FROM GRAPHS
GraphGen creates synthetic data for LLM fine-tuning from knowledge graphs. Integrated with LlamaFactory, it uses structured knowledge to generate quality samples. 1231 Gi
★ 1,234 · PythonNative AI Assistant
Free open-source AI assistant for interviews and meetings, the best alternative to Cluely, Final Round AI, and Interview Coder. It provides real-time transcription, steal
★ 1,229 · TypeScriptCREATE AI AGENTS IN GO
A powerful framework for building intelligent agent systems using LLM and external tools.
★ 1,229 · GoLIGHTMEM — Efficient LLM Memory
Lightweight generation with extended memory from the authors of ICLR 2026. 934 stars on GitHub.
★ 1,223 · PythonR-KV: Compress KV-Cache 1200+ Stars
NeurIPS 2025: smart KV-cache compression for reasoning models accounting for redundancy. Faster, less memory, same accuracy.
★ 1,223 · PythonMAKE MONEY WITH AI PROJECTS
A collection of open AI projects in Python that will help you quickly monetize ideas and automate earnings.
★ 1,221 · PythonNNCFF - ACCELERATING MODEL INFERENCE
NNCFF is a neural network compression framework for accelerated inference in OpenVINO™. It reduces model size while preserving accuracy.
★ 1,221 · PythonAWESOME AI COMPANION: PROJECTS COLLECTION
A list of open-source projects for building long-term AI companions: frontends, backends, memory, hardware, and integrations with the world.
★ 1,220 · PythonUQLM: Detecting LLM Hallucinations
Python package for detecting language model hallucinations based on uncertainty quantification.
★ 1,217 · PythonSelf‑Evolving Data Ontology
Plugin that builds and continuously updates an ontology layer for data agents, enabling Claude Code/Codex to reason over evolving knowledge.
★ 1,213 · PythonDOWNLOAD HUGGINGFACE MODELS EASILY
Go utility for downloading models and datasets from HuggingFace. Supports CLI call and work via API, caches files locally.
★ 1,213 · GoRAGLITE - FAST RAG ON DUCKDB
Simple tool for building RAG pipelines with DuckDB or PostgreSQL in Python.
★ 1,212 · PythonTITLE - AGENT SHELL IN EMACS
Agent Shell is a native Emacs buffer for interacting with LLM agents via the ACP protocol. It lets you chat with AI directly from the editor.
★ 1,210 · Emacs LispSITE FOR DEVELOPERS AI
🌎💎 site-for-developers is a curated list of AI tools created specifically for developers. The project gathers the best tools for working with LLMs, RAG, multimodal mode
★ 1,210CHAT-JS: PRODUCTION-READY AI CHAT
Production-ready AI chat built with TypeScript. Easy to customize and integrate into any project.
★ 1,203 · TypeScriptSUBTITLES FOR ENTIRE SEASONS IN MINUTES
Translates whole season subtitles in one pass. Supports .srt/.ass/.vtt/.lrc, 120+ languages, 27 LLM providers. Timing untouched!
★ 1,201 · TypeScriptHOLLAMA: CHAT WITH LLM IN BROWSER
hollama — a minimal LLM chat that runs entirely in the browser. It connects to local models via Ollama and stores conversations in local storage.
★ 1,199 · TypeScriptAI LEARNING: ROADMAPS
Complete set of roadmaps and resources for AI, ML, DL, and Data Science — from beginner to expert.
★ 1,195TINY VLLM: BUILD YOUR LLM
A mini version of vLLM in C++ and CUDA for fast inference of large language models. Enables building your own high-performance inference engine.
★ 1,194 · C++SAGE: Multi-Agent System for Complex Tasks
Python framework for creating multi-agent systems capable of solving complex tasks together.
★ 1,193 · PythonFOUNDATION MODELS FRAMEWORK
A practical lab for building and testing applications using Apple Foundation Models.
★ 1,192 · SwiftVIM WITH AI ASSISTANT
Plugin vim-ai integrates OpenAI and ChatGPT models directly into Vim/Neovim. It offers code autocompletion, snippet generation, and code explanation via chat with AI. Sup
★ 1,191 · PythonADK‑JS AI Agent Toolkit
ADK‑JS is an open‑source TypeScript toolkit for building, evaluating, and deploying advanced AI agents with full control and flexibility.
★ 1,190 · TypeScriptLLM Inference Optimization Roadmap
A 10‑week plan to study the service and accelerate large language models, covering vLLM, SGLang, quantization, and speculative decoding practices.
★ 1,179 · HTMLRead Papers in Comfortable Chinese
Local app for reading English PDFs in fluent Chinese, with side-by-side source, AI Q&A, and paper organization.
★ 1,177 · JavaScriptGUFO: INFERENCE ENGINE FOR STRIX HALO
gufo — inference engine for AMD Strix Halo in C++. Qwen Flash Next Q4_K_XL delivers 59.41 tok/s (1 user) and 157.22 tok/s (8 users). Qwen27B Q4_K_XL with DFlash2 gives 70
★ 1,176 · C++RUST RUNTIME FOR LLM INFERENCE AND EDITING
larql — Rust runtime to run, serve, and edit models. VINDEX3 format makes models executable and inspectable. 1173⭐ on GitHub.
★ 1,175 · RustLangChain on Elixir
Implementation of the LangChain framework in Elixir, enabling integration of large language models into projects.
★ 1,171 · ElixirCONNECT ATLASSIAN TO AI
The official remote Atlassian MCP server securely connects Jira, Confluence, Bitbucket and other services to AI assistants via OAuth 2.1 or tokens.
★ 1,165 · JavaScriptNEBULA — AI PENTEST ASSISTANT
Automates reconnaissance, note-taking, and vulnerability analysis in penetration tests.
★ 1,162 · PythonPERSONAL AI AGENT
nod — open-source AI agent with its own virtual machine. It follows invoices, prepares calls and cancels trial periods on real websites, asking for confirmation before ac
★ 1,160 · TypeScriptSTRIDE GPT Threat Modeling AI
A strategic tool for automatically generating threat models using the STRIDE methodology with OpenAI's GPT.
★ 1,157 · PythonCONNECTONION AGENT FRAMEWORK
The most advanced framework for collaborative work of AI agents in Python. Allows quickly creating and linking agents for complex tasks.
★ 1,155 · PythonClaude Code for Finance
Claude Code, tailored for the finance sector. Enhances efficiency of analysis, modeling, and decision‑making.
★ 1,154 · PythonFESS: AI SEARCH FOR BUSINESS
Fess is an open source search server built on OpenSearch, indexing web, files, databases and clouds, supporting 20+ languages and semantic search with AI/RAG.
★ 1,151 · JavaAI MOVIE NARRATOR
Generates voiced video recaps of movies from a single text prompt. Combines an LLM for the script, FFmpeg for editing, and Python scripts for full automation. The result
★ 1,148 · PythonRAG-RETRIEVAL UNIFY SEARCH
The project unifies efficient fine-tuning of RAG search methods: embeddings, ColBERT, and reranker.
★ 1,138 · PythonSAG: WORKBENCH FOR DOCUMENT RAG
Ready-to-use workbench for document search based on SAG. TypeScript, 1136 stars!
★ 1,136 · TypeScriptRULESYNC: UTILITY FOR AI AGENTS
CLI utility for managing AI agent rules while coding. 1135 stars on GitHub!
★ 1,135 · TypeScriptGUIDE TO AI SYSTEMS
A practical guide to designing production-ready AI systems and evaluating their quality for engineers.
★ 1,132SCHEMA-GUIDED REASONING AGENT
sgr-agent-core — a framework for building agent systems using Schema-Guided Reasoning in Python from the neuraldeep community.
★ 1,128 · PythonObserval - AI Agent Oversight
Observal is a platform for monitoring, evaluating, and debugging AI agents with human-in-the-loop feedback. It is essential for building reliable production pipelines.
★ 1,118 · PythonMOMO CODE: AI AGENT FOR CODE
MOMO CODE — AI agent for programming in TypeScript with CLI. It evolves together with you, adapting to your coding style and suggesting improvements in real time.
★ 1,112 · TypeScriptRUN MODELS LARGER THAN VRAM
inferssd runs MoE models exceeding RAM and VRAM by streaming experts from SSD. Built on llama.cpp with GGUF, CUDA and Apple Silicon support. 288 stars on GitHub.
★ 1,108 · C++OPENJUDGE - NEW AI EVALUATOR
Unified framework for evaluating the quality of AI agents. 671⭐ Python.
★ 1,105 · PythonJAMAIBASE AI TABLE FOR TEAM
A table where cells are combined into AI pipelines, allowing experimentation with prompts and models in real time.
★ 1,103 · PythonBurp Suite AI Agent
Extension for Burp Suite that adds built‑in MCP tools, AI analysis, privacy controls, and passive and active scanning functions.
★ 1,102 · KotlinCOMARK: MARKDOWN PARSER WITH AI SUPPORT
Comark is an open-source Markdown parser and renderer that supports components, attributes and plugins. It streams AI output to React, Vue, Svelte, Angular, HTML and the
★ 1,101 · TypeScriptONTOGPT: ONTOLOGY EXTRACTION
Ontogpt — an LLM‑tool for extracting ontologies from text, including the SPIRES method. It builds hierarchical taxonomies and generates OWL/RDF schemas ready for use in d
★ 1,099 · Jupyter NotebookMARKLLM: WATERMARK FOR LLM
MarkLLM — open-source toolkit for watermarks of large language models. Allows embedding, checking and comparing different watermark schemes. Supports popular LLM and inte
★ 1,093 · PythonAWESOME MCP SERVERS: TOP LIST
A collection of the best Model Context Protocol servers for convenient work with AI agents.
★ 1,092POWERFUL TOOLS FOR AGENTS
A set of Python tools that extend the capabilities of AI agents.
★ 1,089 · PythonAGENTICX — MULTI-AGENT PLATFORM
AGENTICX — a production‑ready multi‑agent framework for Python that includes an SDK, CLI, Studio server, and the Machi desktop app.
★ 1,085 · PythonTURN YOUTUBE INTO SHORTS IN MINUTES
Windows app turns long YouTube videos into vertical 9:16 clips. AI detects best moments, tracks face, and adds word-by-word captions.
★ 1,084 · TypeScriptMULTI-AGENT CAD 3D GENERATOR
A framework for generating CAD models from natural‑language text using multi‑agent collaboration and bounded test computation.
★ 1,081 · PythonLangChain on C#: AI Agent
C# implementation of LangChain, as close as possible to the original, open to new entities.
★ 1,080 · C#CHROMEM-GO: VECTOR DB WITH ZERO DEPENDENCIES
Embeddable vector DB in pure Go. Chroma-like API, zero external deps, runs in-memory with optional persistence.
★ 1,078 · GoFLOCK: MULTI-AGENT PLATFORM ON RUST
Desktop framework for multi-agent systems built with Rust, Tauri, and React, with LangGraph support.
★ 1,077 · RustNew projects on this topic in Telegram
Telegram →