LLM: open-source projects on GitHub
2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
GENERATIVE AI FOR BUSINESS
The project demonstrates practical scenarios of applying generative AI in corporate processes with an emphasis on security and scalability.
★ 1,403 · TypeScriptRTP-LLM ENHANCED LLM INFERENCE
High-performance LLM inference engine from Alibaba, written in CUDA, enables fast model operation across diverse applications.
★ 1,400 · Cudaaws-genai-llm-chatbot - POWERFUL CHATBOT ON AWS
Modular solution for a chatbot with multiple LLMs and RAG on AWS CDK. Integrate Anthropic, OpenAI, HuggingFace models.
★ 1,399 · TypeScriptLLM IN SPACY PIPELINE PAINLESSLY
spacy-llm connects GPT, Claude, Cohere and open models to spaCy pipeline. Configure via config, get structured Doc with entities and relations. No wrapper code — pure NLP
★ 1,399 · PythonEvolving Skills for AI
Collective skill evolution through an agent evolver — let skills develop alongside your AI.
★ 1,395 · PythonKVCache-Factory: Cache Compression for LLM
Unified KV-cache compression methods for autoregressive models. Memory savings and faster inference in one package.
★ 1,394 · PythonWLLAMA: LLM in Browser, No Server
WebAssembly binding for llama.cpp allows running large language models directly in the browser.
★ 1,392 · TypeScriptPRUNA - ACCELERATING MODELS
Pruna — a Python framework for model optimization that speeds up inference and reduces resource usage without losing accuracy.
★ 1,391 · PythonSUGGESTARR: AUTO PICK
Automatically requests movie and series recommendations for Overseerr/Jellyseerr based on viewing history from Plex, Emby, or Jellyfin.
★ 1,391 · PythonOPENSOURCE SLACK WITH AI AGENTS
Self-hosted Slack alternative. Teams and AI agents collaborate in channels and DMs. Agents on Claude, GPT, Gemini, Grok with MCP, browser, memory, approvals. Docker Compo
★ 1,391 · TypeScriptOPENGENERATIVE UI - EASY GENERATIVE INTERFACES
OpenGenerativeUI is an open-source TypeScript framework for quickly creating generative interfaces with AI support.
★ 1,384 · TypeScriptNPCPY: LIBRARY FOR NLP AND LLM
The npcpy library simplifies research in NLP, multimodal LLMs, and agent creation by combining ML, knowledge graphs, and more.
★ 1,379 · PythonAWESOME-LLM-RAG: BEST RAG SOLUTIONS
A collection of the best resources and libraries for building Retrieval Augmented Generation in large language models.
★ 1,374CHIDORI: Reliable Agent Framework
The Rust framework makes each agent run durable, reproducible, and resumable by default.
★ 1,373 · RustAI Model Price Finder
Grandet lets AI agents discover the cheapest API for any model and connect via its Skill and anonymous MCP server, using price data from over 1,800 providers.
★ 1,372 · JavaScriptawesome-deepseek-harness - SPEEDING WORK WITH DEEPSEEK
Ecosystem of plugins and tools for DeepSeek Harness: ready-made solutions from dsh-external/hub and the public topic dsh-plugin.
★ 1,370 · PythonOpenMed AI for Healthcare
OpenMed is an open-source Python project using AI for medical data analysis and clinical decision support.
★ 1,365 · PythonREPOBRAIN — BRAIN FOR YOUR CODE
RepoBrain turns your repository into a smart assistant: ask questions about the code in plain language. It supports Claude Code, Cursor, Codex, Windsurf, and more.
★ 1,362 · PythonLANGCHAIN ON RUST: LLM APPS MADE SIMPLE
LangChain for Rust — official port of the popular framework. Write LLM apps in Rust with the same simplicity as Python.
★ 1,362 · RustLLM CODE COMPLETION
VS Code extension for LLM-powered code and text autocompletion. 1359 stars on GitHub.
★ 1,359 · TypeScriptVoice input with AI processing
Hold the key, speak, release — AI-enhanced text will appear next to the cursor in any application.
★ 1,356 · HTMLFAST LAUNCH QWEN3.8 ON AMD
The project provides scripts for instant deployment of Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151) GPU via HIP. All dependencies are built automatically, and inference
★ 1,349 · ShellLEARNCOPILOT: AI Proof Assistant
The project uses large language models as a copilot to assist in proving theorems in Lean.
★ 1,345 · C++MULTI-AGENT LLMS SURVEY 2024
A comprehensive review of LLM-based multi-agent systems — progress, challenges, and prospects. The paper has been accepted at IJCAI 2024.
★ 1,335Cairn AI State Search
Cairn is an AI-powered state‑space search engine, initially tested for autonomous pentesting. Written in Python, it has already garnered over 1.3k stars.
★ 1,333 · PythonMeridian Proxy for Claude Max
Meridian is a custom proxy that lets you use your Claude Max subscription with OpenCode, Pi, Droid, Aider, Crush, Cline, and other tools. 1328 stars on GitHub.
★ 1,328 · TypeScriptHACKINGBUDDY GPT HELPER
The project helps ethical hackers use LLMs in 50 lines of code or less. Rapid AI integration into pentest workflows.
★ 1,328 · PythonBEDROCK-CHAT: AWS CHATBOT IN TYPESCRIPT
AWS-native chatbot on Bedrock, written in TypeScript, for quickly creating AI assistants.
★ 1,325 · TypeScriptSEAGOAT: LOCAL SEMANTIC SEARCH
SeaGOAT — a local semantic code search engine that works without cloud dependency. It uses embeddings and tree‑sitter to index the repository and search by meaning, not e
★ 1,322 · PythonTAU2-Bench: Benchmark for AI Agents
τ-Bench tests AI agents in real‑world tasks. The Python project already has 1.3k stars.
★ 1,319 · PythonAI-Setup: One-Key Sync
Sync AI-agent settings for Claude Code, Cursor, and Codex with a single command. Supports skills, MCP files, and configs.
★ 1,315 · TypeScriptAUTONOMOUS LLM AGENTS
A collection of research papers on LLM-based autonomous agents. Updated daily — 1311 stars on GitHub.
★ 1,311Mini‑pi on TypeScript
An ultra‑compact implementation of π in TypeScript (~600 lines) that lets you build your own pi‑agent from scratch for any task.
★ 1,308 · TypeScriptREACT NATIVE AI - MOBILE APPS
A full-featured TypeScript framework for building cross-platform mobile apps with AI.
★ 1,305 · TypeScriptPARALLAX: BUILD AI CLUSTER
Parallax lets you quickly deploy a distributed inference service on any infrastructure.
★ 1,301 · PythonClawBench - Benchmark for AI Agents
Open-source benchmark for evaluating browser AI agents on everyday tasks. Already earned ⭐ 385!
★ 1,301 · PythonTRACELY-AI - AUTOMATED AGENT TESTING
Tracely-ai automatically turns AI agent failures into regression tests that block PRs and reproduces them in CI for free.
★ 1,299 · PythonLLM AUTOMATICALLY COLLECTS WIKI
Knowledge compiler: raw sources → interlinked wiki. Inspired by Karpathy's LLM Wiki pattern; TypeScript, ⭐1292.
★ 1,292 · TypeScriptKUBEAI – Integral Inference Operator
AI Inference Operator for Kubernetes: the simplest way to deploy ML models in production. Supports VLM, LLM, embeddings, and STT.
★ 1,291 · GoLABS-MOLT: AGENTIC RL FRAMEWORK FOR RESEARCH
Scalable framework for agentic RL built on HuggingFace and supporting context‑ and expert‑parallelism with FSDP. Contains 9 000 lines of Python and already has 1 164 star
★ 1,290 · PythonFull-Stack AI Template
Fullstack app generator for FastAPI and Next.js featuring AI agents, RAG, streaming, authentication, and 20+ ready integrations.
★ 1,289 · PythonQUICKLY TRAIN SPECULATIVE DECODER
SpecForge simplifies training speculative decoding models and exporting them to SGLang for high-performance serving.
★ 1,285 · PythonOPEN AUTONOMOUS ANDROID AGENT
opendroid — production-ready autonomous agent for Android. Plans tasks itself and controls screen via Accessibility API. Works with local and remote LLMs.
★ 1,285 · KotlinMYSQL_MCP_SERVER - SECURE ACCESS TO DATABASE
The MCP server provides secure interaction with MySQL via a standard protocol, simplifying integration of AI agents with databases.
★ 1,283 · PythonCOORDINATION OF CLAUDE CODEX CURSOR
squadra synchronously manages windows of Claude, Codex and Cursor: tasks, prechecks, parallel tests. Built-in skills recall lessons, simplify code and forecast work.
★ 1,279 · PythonAwesome AI Agents — LLM-based Collection
A large collection of LLM-based autonomous agents 🤖️, ranging from simple to advanced scenarios.
★ 1,275ATTACKGEN: AI INCIDENT RESPONSE
Generates realistic cyberattack scenarios using LLM and MITRE ATT&CK, tailored to your organization and selected threat groups.
★ 1,275 · PythonShogun: Multi-Agent System
A system of parallel AI tasks for Claude Code featuring a shogun → karō → ashigaru hierarchy via tmux.
★ 1,273 · ShellRIZZO PII: Document Anonymization
A local Python utility that removes personal data from files before sending them to an LLM. Protect your privacy without leaving your computer.
★ 1,271 · PythonWINDOWS COPILOT API FREE
Reverse‑engineered Windows Copilot as a compatible OpenAI REST API. Access GPT‑4 and GPT‑5 without keys or payment.
★ 1,270 · PythonOLLAMA GUI: LOCAL CHAT AI
Web interface for chatting with local LLMs via the Ollama API. Allows switching models, keeping chat history, and adjusting generation settings directly in the browser. W
★ 1,270 · TypeScriptvllm-mlx LLM Server
OpenAI and Anthropic compatible server for Apple Silicon that runs LLMs and vision models with continuous batching and MCP tool calling, achieving 400+ tokens/s.
★ 1,260 · PythonNAUTILUS COMPASS: RELIABLE MULTI-AGENT
Nautilus Compass adds reliability to multi-agent systems without an orchestrator. It provides cross-dialog contracts, detects behavioral drift, and maintains a black-box
★ 1,258 · PythonANGELSLIM: COMPRESSING MODELS WITHOUT LOSS
A tool for model compression focusing on convenience and efficiency. 1257 stars on GitHub.
★ 1,257 · PythonFAST ALTERNATIVE FIRECRAWL IN RUST
crw — fast Firecrawl/Tavily alternative in Rust: web scraper, crawler and search API with MCP server for AI agents. Compatible API (/scrape, /crawl, /search), runs 2.3× f
★ 1,257 · RustKVPRESS: LLM CACHE COMPRESSION
Library for easy compression of LLM KV‑cache, accelerating generation and reducing GPU memory consumption.
★ 1,254 · PythonLLMGATEWAY: UNIFIED API FOR ALL LLM
Manage requests to different LLM providers through a single unified interface. 1.2K ⭐ on GitHub.
★ 1,252 · TypeScriptLightAgent: AI Agent with Memory
A lightweight framework for AI agents with memory, MCP, and skills. Supports multi-agent interaction, self-learning, and major LLMs.
★ 1,247 · Pythonantigravity-workspace-template - Multi-agent engine for code
Multi-agent knowledge system for Claude Code, Cursor, Codex CLI with answers based on code and file line numbers. Works in any AI IDE.
★ 1,246 · PythonRECOMMENDATIONS ON STEROIDS
A framework for recommendation models on PyTorch. Easy to use and easily extensible.
★ 1,242 · Jupyter NotebookNew projects on this topic in Telegram
Telegram →