LLM: open-source projects on GitHub
2095 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
TOSHLLM: RUN LLM ON MAC
TOSHLLM — a native macOS app in Swift that runs large language models locally on Intel‑Mac with AMD GPU, using Metal acceleration. Supports llama.cpp and is compatible wi
★ 258 · SwiftMATTERMOST PLUGIN AGENTS – MULTI SUPPORT
Plugin for Mattermost that enables using multiple LLMs in a single agent. Quick setup and reactive responses.
★ 257 · GoREAL-TIME MULTIMODAL AI PIPELINES ON APPLE SILICON
vpipe runs LLMs and image generation in real time on Apple Silicon. Uses ANE and Metal for maximum performance without GPU.
★ 257 · C++BAIBOT: MATRIX BOT FOR AI
A Matrix bot that unifies text, speech, and image generation via LLMs from OpenAI, Anthropic, and others. Written in Rust.
★ 256 · RustInteractive AI Learning App
A TypeScript-based desktop application offering 51 hands‑on labs that teach ML basics, transformers, RAG, agents, fine‑tuning, and quantization.
★ 256 · TypeScriptXAGENT - AI Work Agent
Xagent is a platform for building dynamic AI agents that plan, use tools, and perform real‑world tasks without rigid workflows.
★ 255 · PythonMISAKA-AGENT:THE MULTI-AGENT INVESTIGATIVE FRAMEWORK
Misaka-Agent — a multi-agent investigative infrastructure for humanities and socio-cultural disciplines on Python. Enables creating groups of LLM agents that jointly anal
★ 255 · PythonCLAWDRiP - Claude Errors and Issues
A collection of Claude's mishaps: bugs, odd responses, and lessons for improving AI agents.
★ 254 · TypeScriptANKI-MCP-SERVER - MANAGE ANKI VIA MCP
MCP server for Anki that lets you manage cards and decks via a simple HTTP API, compatible with any AI agents.
★ 254 · TypeScriptFREE ML COURSES FROM TOP UNIVERSITIES
Collection of free machine‑learning courses from MIT, Stanford, Berkeley, CMU, NYU and UChicago. All lectures and yearly editions gathered on one searchable page.
★ 254 · AstroIRANIAN WEB FOR AI AGENTS
71 MCP servers and 883 tools connect AI agents to Iranian services: Digikala, Torob, Divar, Snappfood, Alibaba, Neshan and more. Prices in Toman.
★ 254 · PythonModel-Agnostic Quantization Framework
Quantize and run text, image, video, and audio models across GGUF, llama.cpp, vLLM, Diffusers, and PyTorch with state-of-the-art model-agnostic quantization.
★ 254 · C++OMNICOREAGENT: HARNESS FOR PRODUCTION AI AGENTS
Open Python harness for production AI agents. Supports tools, MCP, memory, workspace, telemetry. Includes subagents, background tasks, and OmniServe APIs. 245 stars.
★ 253 · PythonMIXDOG: OPEN SOURCE AI CODING AGENT
Desktop agent on Electron where lead model plans tasks and cheaper models handle search, edits and review. Supports Claude, Codex and local LLMs. 202 stars on GitHub.
★ 252 · JavaScriptAI MEMORY FOR DEVELOPMENT
The knowns project adds long‑term memory to AI about your code, enabling models to understand its structure and changes in real time.
★ 251 · GoZABBIX MCP SERVER FOR AI
MCP server for the full Zabbix API: 237 tools, multi‑server, OAuth 2.1 + bearer, PDF reports, systemd‑ready. Works with ChatGPT, Claude, VS Code, Codex, JetBrains and any
★ 251 · PythonNYT Connections: LLM Benchmark
A benchmark based on 759 NYT Connections puzzles with additional trick words for evaluating LLMs.
★ 250 · PythonTop AI Agent Frameworks 2026
Curated list of frameworks, tools, and resources for building AI agents in Python in 2026.
★ 250 · PythonCONTROL AI AGENTS COMMAND CENTER NOW
The control panel for AI agents: launch, coordinate, and monitor numerous agents in real time. It supports integration with Anthropic Claude and workflow automation via p
★ 250 · JavaScriptDS AUTO-REVIEW:AI SYSTEM
dsh-auto-review offers a read-only subagent that returns allow/deny with reasons for DeepSeek Harness approval requests. Verdict is fail-closed by default; the chain appr
★ 249 · TypeScriptSECRET AI FOR YOUR DESK
Garden‑desk is a private AI agent that runs locally on TypeScript. It enables multi‑agent workflows, works with local LLMs and shares context within the team. All data st
★ 249 · TypeScriptCARBON TRACK CLAUDE CODE!
claude-carbon measures CO₂ emissions when using Claude Code showing them in realtime.It integrates into your workflow and stores data for analysis.
★ 249 · ShellAuto-Tune LLM Serving Speed
Automatically optimizes local LLM serving speed via hill-climbing across decode, speculative decoding, prefill, KV cache, and startup metrics on any hardware.
★ 249 · PythonREADY NOTEBOOKS FOR AI
Ultralytics provides a collection of Jupyter notebooks for a quick start with computer vision and AI models. Run experiments in one click.
★ 248 · Jupyter NotebookSUBTEXT: BEHIND THE MODEL
A tool for analyzing hidden representations of AI models, revealing their internal logic.
★ 248 · HTMLTINYBOT - PERSONAL AI AGENT
Tinybot is a lightweight personal AI agent in Python, constantly improving and ready to help with everyday tasks.
★ 247 · PythonAccordion - Intelligent Context Management
Accordion is an AI assistant for managing code context, winner of the UC Berkeley AI Hackathon 2026. It reduces developer workload.
★ 247 · TypeScriptOPEN JEV AGENTS INSTANTLY
The awesome-jev project collects demos, projects, SDKs and Jev skills with source links and a curated X gallery. It covers agent‑skills, AI agents, browser automation and
★ 247 · PythonPORTABLE HERMES AGENT FOR WINDOWS
Portable Hermes Agent is a desktop for Windows with over 100 AI‑tools, GUI and support for local models via LM Studio. It includes TTS, music generation, ComfyUI workflow
★ 247 · PythonOPTIMIZED AiNiee-NEXT UV
AiNiee-Next — an optimized Next for AiNiee based on UV, providing intelligent format conversion, multi‑profile configuration, and a stable TUI interface. Designed for eff
★ 247 · PythonLOCAL ACTIVITY TRACKER WITH AI
Hindsight tracks desktop activity locally. AI creates daily reports on-device. Optional multi-device sync included.
★ 247 · RustSPICE: AI Agent Brain
Spice is the decision‑making brain for agent systems: it perceives context, compares options, and manages execution.
★ 246 · PythonPGEDGE MCP: POSTGRES NEURAL AGENT
MCP server for PostgreSQL allows natural language database management via CLI and web-UI.
★ 246 · GoTWO AI VTUBERS LIVE SHOW
Lumi_Nox is a realtime engine for two AI VTubers co-hosting a live show. Open-core, battle-tested by daily streams. Python, Live2D, LLM, multi-agent orchestration.
★ 246 · PythonEQUİBLES: MCP SERVER OF FINANCIAL DATA
Equibles — self host MCP server in C# with 64 tools for SEC filings, XBRL financials, 13F holdings, insider/congress trades, FRED, CFTC/CBOE and daily prices. Cloud versi
★ 245 · C#🔥 AI Job Agent
LLM tool for skill analysis, AI interviews, resume scoring, and job vacancy structuring with adaptive complexity.
★ 244 · PythonAI TUTOR RAG SYSTEM
A repository with course notebooks for building an LLM‑based tutor based on the Towards AI course, featuring Jupyter notebooks for creating an LLM‑tutor using RAG. Practi
★ 244 · Jupyter NotebookAlbatross: Open AI Agent
Albatross is an open terminal AI agent with transparent multi‑model routing. It runs locally via Ollama, LM Studio, MLX or in the cloud using your API keys.
★ 244 · RustPRISMA: PHP LLM Package
Lightweight PHP package for connecting multimedia AI models via a unified interface.
★ 244 · PHPMEDICAL_IMAGE_ANALYSIS - AI ANALYSIS OF MEDICAL IMAGES
The project uses foundation models for medical image analysis, providing high accuracy and speed of diagnosis.
★ 243 · PythonTS-BENCH: AI AGENTS BENCHMARK
CLI tool for comparing the performance of AI agents in TypeScript tasks.
★ 243 · TypeScriptDOBERMAN-CORE — PROTECTION FOR AI AGENTS
Doberman-Core intercepts every input, output, and tool call during AI-agent operation, blocking unsafe actions. It works as middleware, checking authorization and applyin
★ 243 · PythonSAVE TOKENS IN CLI
Local CLI optimaizr finds wasted tokens in Claude Code, Codex, opencode and your API calls. Analyzes spending and shows where money is lost. Supports TypeScript projects
★ 243 · TypeScriptHUMAN AND AI: COLLABORATIVE SYSTEMS
Overview of LLM‑supported human‑agent interaction systems. Complete list of resources and practical guides.
★ 242PORTAINER MCP — OFFICIAL PYTHON SERVER
Official Portainer MCP server in Python — simplifies container management and orchestration via MCP API.
★ 242 · PythonJ-WASH: LLM TOOL
Tool for manual alignment of large language models using Jacobian Lens, with results exported.
★ 242 · PythonONE API FOR 100+ MODELS
Linten is an open-source AI gateway with a single OpenAI-compatible API for 100+ models. Supports virtual keys, spend tracking, routing, and guardrails. Self-hosted deplo
★ 242 · PythonCONTRIB AI: AUTONOMOUS AGENT
An autonomous AI agent written in Rust searches repositories, analyzes code, generates fixes, and submits PRs.
★ 241 · RustDSPY.RB: Ruby for AI
dspy.rb is a Ruby framework that lets you program language models instead of writing prompts. It simplifies creating AI agents and integrating with LLMs.
★ 241 · RubyPHAROS: LOCAL AI RAG
Local agentic RAG system for ingesting documents of multiple formats, hybrid search, and corporate access control.
★ 241 · PythonPRECISE GATEWAY FOR AI TOOLS
Local MCP gateway provides a single port for all tools and AI clients. It enables lazy discovery with ~90% token savings, verifies tool integrity and quarantines suspicio
★ 241 · RustZJT AI DRAMA GENERATOR
ZJT is an open-source platform on Python that uses AI to automatically create short dramas. From script and storyboard to video synthesis — the entire process is hands-fr
★ 241 · PythonHERMES LIFE OS AGENT
Personal OS agent studies you, detects life patterns and gets smarter daily thanks to memory, cron‑scheduler and RL Atropos. Written in Python, uses Claude and Anthropic,
★ 241 · PythonFREE CODING MODELS WITHOUT KEYS
bansos-router unites free coding models in one local endpoint. No API keys — just connect and let neural nets write code.
★ 241 · TypeScriptQVAC Local AI SDK
QVAC lets you run LLM, speech recognition, and translation locally on all platforms — from PC to smartphone.
★ 240 · TypeScriptAGENT-PULSE AI TRENDS REAL TIME
Agent‑Pulse gathers evidence‑based data on the AI industry: daily trend updates, source updates, and weekly briefs for decisions.
★ 240 · TypeScriptCURATOR LIST OF AI AGENTS
Collection of resources on AI agent evolution, their memory, multi-agent architectures, and self-improvement. Includes links to frameworks, protocols, and JavaScript code
★ 240 · JavaScriptGUIDE TO AI ARCHITECTURE
awesome-ai-architect — curated guide list blending AI engineering with solution architecture. Speeds junior‑to‑senior AI‑architect growth via clear roadmaps, templates, i
★ 240AI PET ON YOUR SCREEN
Roamies are desktop pets with AI living on your screen. They remember promises, remind you of tasks, and point at important things. Work on macOS and Windows with any AI
★ 240 · JavaScriptGO AI SDK: UNIFIED API
Go AI SDK provides a unified interface for over 21 LLM providers, including OpenAI, Anthropic, and Azure. It supports streaming generation, structured JSON output, and Mo
★ 239 · GoNew projects on this topic in Telegram
Telegram →