LLM: open-source projects on GitHub
2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
Modular LLM Apps in Rust
⚙️🦀 Build modular and scalable LLM applications in Rust
★ 7,409 · RustTURBO-FIELDFARE - GEMMA 4 ON MACBOOK
Run Gemma 4 26B‑A4B on any MacBook with an M‑series chip using under 2 GB of RAM. Fast and with no extra resources.
★ 7,391 · SwiftAI Prompt Master
A skill for Claude that creates precise prompts for any AI tool without losing tokens or credits.
★ 7,377AI partner for 300+ models
ForgeCode is an AI coding assistant that works with Claude, GPT, O Series, Grok, Deepseek, Gemini, and over 300 models.
★ 7,297 · RustMISTRAL.RS — FAST LLM ON RUST
Fast and flexible engine for inference of large language models. 7.2K stars on GitHub.
★ 7,197 · RustMULTI-MODEL AI WORKSPACE FOR EXPERTS
Open-source AI workspace for experts with 800+ model support. Allows switching models mid-chat, tuning 40+ parameters, and running Beam comparison using your own API keys
★ 7,167 · TypeScriptOPENLLMETRY LLM MONITORING
Open-source tool for GenAI and LLM application observability based on OpenTelemetry. 7.1k stars!
★ 7,158 · PythonOPENSQUILLA: EFFECTIVE AI AGENT
OpenSquilla — a token‑efficient AI agent that, with the same budget, provides greater intelligence density. Implemented in Python and compatible with popular LLMs for bui
★ 7,150 · PythonOPEN SOURCE BROWSER FOR AI AGENTS
Steel Browser is a ready-made sandbox for web automation. Forget infrastructure and focus on tasks.
★ 7,111 · TypeScriptCURSOR-TALK-TO-FIGMA-MCP AI WORKS WITH FIGMA
MCP integration between an AI agent (Cursor, Claude Code, Codex) and Figma, allowing to read and modify designs programmatically.
★ 7,109 · JavaScriptSMOLVM: VIRTUAL SANDBOX FOR AGENTS
Smolvm — embeddable, portable, and branchable virtual machine in Rust for safely running AI agents locally. The project already has 6.5k stars and supports integration wi
★ 7,101 · RustAI INFOGRAPHIC — ANIMATE WORDS
Infographic — a TypeScript framework for creating infographics using AI. Turn text into visuals in seconds.
★ 7,100 · TypeScriptFLYTE: AI Workflow Orchestration
Flyte is a dynamic and resilient platform for AI orchestration, enabling easy unification of data, models, and compute resources into cohesive workflows.
★ 7,059 · GoLLM evaluation platform
OpenCompass is an LLM evaluation platform supporting a wide range of models (Llama3, Mistral, InternLM2, GPT-4, LLaMa2, Qwen, GLM, Claude, etc.) across 100+ datasets.
★ 7,022 · PythonGUARDRAILS FOR RELIABLE LLMS
Adds constraints and checks to large language models, making them safer and more reliable.
★ 6,967 · PythonAI-AUTONOMOUS PENTEST AND VULNERABILITY MANAGEMENT
Faraday — open-source platform for autonomous pentesting and vulnerability management. AI agents scan, exploit, and prioritize CVEs. 6800+ stars on GitHub.
★ 6,859 · PythonTAXHACKER - SMART ACCOUNTANT AI
Self-hosted AI accounting: analysis of receipts, invoices, and transactions using LLM, custom prompts, and categories.
★ 6,827 · TypeScriptllm-scraper - LLM Web Scraping
Turn any web page into structured data using powerful LLMs – no parsing or regex needed.
★ 6,811 · TypeScriptOSMEDEUS: SECURITY IN ONE CLICK
Osmedeus automates security testing and vulnerability scanning in Go. Fast, scalable, in a single pipeline.
★ 6,656 · GoUNSTRACT — LLM vs Data Strings
Extract structured data from unstructured documents using LLM. Ready for deployment via API and ETL pipelines. ⭐ 6624
★ 6,624 · PythonDECEPTICON AUTONOMOUS AGENT HACKING
Autonomous agent for Red Team, written in Python using LangChain and generative AI. Performs reconnaissance, exploitation and post‑exploitation without operator intervent
★ 6,605 · PythonSuperagent AI Protection
Superagent protects AI applications from prompt injections, data leaks, and harmful outputs by embedding security directly into your product.
★ 6,596 · TypeScriptJULEP - LONG-TERM AI AGENT
Julep provides reliable, composable AI agents that can recover from failures and transparently explain each step.
★ 6,581 · Jupyter NotebookAI Coding for Neovim
AI plugin for Neovim: chat, inline editing, and agents with tools. Support for OpenAI, Claude, Gemini, Ollama, and other providers.
★ 6,570 · LuaFUNCLIP: VIDEO EDITOR WITH AI
FunClip is an open-source tool for accurate speech recognition in video and quick clip creation using LLM. Easy to use, supports Python.
★ 6,562 · PythonLLM Router for OpenClaw
An LLM router for OpenClaw supporting 41+ models, sub‑millisecond routing, and USDC payments on Base and Solana via the x402 protocol.
★ 6,550 · TypeScriptAI Humanizer for Korean
A Python project that turns machine‑generated Korean text into natural human‑like prose, fixing translationese and 71 AI indicators.
★ 6,547 · PythonDATA-JUICER: DATA FOR FOUNDATION MODELS
A data processing tool for working with foundation models in Python. Over 6500 stars on GitHub!
★ 6,500 · PythonOPENUI: Open Generative UI Standard
Generative interface — now standardized. 6463 stars already using.
★ 6,463 · TypeScriptSMILE - AI ENGINE ON JAVA
SMILE — Statistical Machine Intelligence & Learning Engine, a powerful framework for building machine learning models in Java.
★ 6,438 · JavaAWESOME AGENT SKILLS CATALOG
awesome-agent-skills — curated catalog of tutorials, guides and skills for creating AI agents in TypeScript. The project has 6.3k stars and covers topics agent-skills, AI
★ 6,389 · TypeScriptAIRWEAVE: AI AGENTS GITHUB CONTEXT
Open context extraction layer for AI agents. Python tool with 6K+ stars!
★ 6,379 · Python220+ AI TOOLS IN ONE PLACE
Curated list of 220+ AI tools across 37+ categories: chatbots, coding agents, video/image/voice generation, open-weight models. 6.3k stars on GitHub.
★ 6,344 · PythonHTML Answer Agent
Provides AI agents with a skill that returns a clean, one‑page HTML answer to difficult questions.
★ 6,324 · JavaScriptCHRONOS-FORECASTING - SMART TIME SERIES FORECASTING
Chronos provides a set of pretrained models for accurate time series forecasting out of the box in Python.
★ 6,310 · PythonAI Next.js Template
Open-source Next.js template for building applications fully generated by artificial intelligence. From E2B.
★ 6,282 · TypeScriptABOGEN: AUDIOBOOKS FROM EPUB
Convert EPUB, PDF, and text into audiobooks with synchronized subtitles in one click.
★ 6,234 · PythonRAVEN: MEMORY AND SELF-LEARNING
Raven is an EverOS agent with memory‑first, self‑learning and improving in Python.
★ 6,216 · PythonMARVIN: AMBIENT AI
Marvin is a Python library for building ambient‑intelligence agents. It lets you quickly create chatbots and LLM apps with GPT model support.
★ 6,204 · PythonAI FRAME FOR DEVICES
This project offers low-bit quant kernels and runtime for consumer devices on Android/ARM. It solves edge-ai tasks with minimal resources.
★ 6,192 · C++LOBSTERAI AI AGENT FOR WORK
Open-source desktop AI agent: data analysis, slides, documents, web research, control via WeChat, Feishu, DingTalk, and Telegram.
★ 6,190 · TypeScriptProgramming Agent
A coding automation tool powered by an AI agent for jcode projects.
★ 6,186 · RustEngineering Guide
Official guide to engineering practices in Harness: step by step from beginner to expert.
★ 6,173 · TypeScriptAI-YOUTUBE SHORTS WITHOUT WATERMARKS
Generator of short videos from long YouTube clips using LLM highlight extraction, Whisper transcription, and auto-crop to vertical.
★ 6,095 · PythonTRAFILATURA - FAST WEB PARSE
Trafilatura extracts clean text and metadata from pages, supporting CSV, JSON, HTML and other formats.
★ 6,055 · PythonVLM-R1: Smart Image Recognition
The project demonstrates how reinforcement learning improves image understanding by multimedia models.
★ 6,046 · PythonAutomatic Work Journal
The automatic work journal that privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first.
★ 6,037 · SwiftENCHANTED - CHAT WITH OPEN MODELS
Enchanted — an iOS and macOS app that lets you chat with local Llama2, Mistral, and Vicuna models via Ollama.
★ 6,019 · SwiftHARNESS-SDK: CREATE AI AGENT FAST
A model-driven SDK lets you create AI agents in just a few lines of Python code.
★ 5,999 · PythonGenkit AI Framework
An open-source framework for building AI applications in JavaScript, Go, and Python. Developed and used at Google.
★ 5,985 · TypeScriptConfigless code flow
Automates code integration with Claude and Codex without requiring configuration, speeding up development.
★ 5,980 · TypeScriptMAKA - LOCAL AI AGENT WORKSPACE
Apache Maka is a local AI workspace where every agent step is recorded in an immutable log.
★ 5,968 · TypeScriptQOwnNotes — Notepad with Markdown and Nextcloud
Plain‑text notes and tasks manager with Markdown support and Nextcloud/ownCloud integration. 5,791 stars on GitHub.
★ 5,962 · C++AGENTOPS: AI AGENT MONITORING
Python SDK for monitoring AI agents, tracking LLM costs, and benchmarking. Support for all popular frameworks.
★ 5,960 · PythonSylinko Smart Assistant
Context-aware AI assistant for the desktop that intelligently answers requests and works easily with various LLMs and MCP tools.
★ 5,956 · C#Strands Agents SDK
A model-based approach to creating AI agents in just a few lines of code.
★ 5,888 · PythonRUN VLM LOCALLY ON MAC
mlx-vlm runs and fine-tunes vision-language models (LLaVA, Florence-2, Idefics) on Apple Silicon via MLX. Everything works locally on your Mac without GPU servers.
★ 5,847 · PythonLLM FROM SCRATCH IN PYTORCH
The reasoning-from-scratch project shows how to build a Reasoning LLM from scratch in PyTorch, step by step. Implemented in Jupyter notebooks: architecture, training with
★ 5,831 · Jupyter NotebookAI-POWERED VIRTUAL EXECUTIVE TEAM
OpenExecutive — a single AI executive backed by 8 specialist agents. Stack: FastAPI + Next.js, Claude. 5.8k stars on GitHub.
★ 5,812 · PythonHELICONE LLM OBSERVE
Open source platform for LLM observability: monitoring, evaluation, and experiments in one line of code. Supports TypeScript and already has 5.8k stars.
★ 5,805 · TypeScriptNew projects on this topic in Telegram
Telegram →