LLM: open-source projects on GitHub
2095 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
OPEN FRAMEWORK FOR AI AGENTS
openai-agents-go — a lightweight framework in Go for building multi-agent workflows with LLM. Allows dynamically connecting agents, executing tasks in parallel, and integ
★ 278 · GoPOCKET-TANK LLM ON ESP32
The pocket-tank project implements a 14M‑parameter LLM on an ESP32‑S3 chip in just 7.56 MB, distilled from a 26B teacher model. It runs completely offline, without any ne
★ 278 · CCURATED LIST OF OPD RESOURCES
A collection of papers, frameworks, and tools for on‑policy distillation of large language models. Ideal for LLM researchers and engineers.
★ 277MCP-FOR-STATA - STATA IN AI AGENT
mcp-for-stata connects Stata to AI agents through a simple Python interface, accelerating data analysis and workflow automation.
★ 277 · PythonWIKI FROM DOCUMENTS WITH LINKS
Transform documents into a Markdown wiki with precise source links. Run locally via Ollama or any LLM provider, using the CROW classifier router to boost accuracy to 89%
★ 277 · PythonRESUME-JOB MATCHER: AI CANDIDATE FILTER
TypeScript CLI for AI resume screening: hard constraints filter out unfit candidates before scoring, each score cites the resume span, and an embedding pre‑filter makes s
★ 275 · TypeScriptSDK FOR WHATSAPP AI AGENTS
Open-source SDK for building AI agents in WhatsApp. Connect your own model, number, and data. Runs locally, no cloud, no vendor lock-in.
★ 275 · TypeScriptFREELINGO: AI TUTOR FOR LANGUAGES
Open-source language learning platform with local and cloud LLMs. Supports CEFR plans, voice chats, flashcards, and spaced repetition. Deploys via Docker Compose.
★ 275 · JavaScriptPATTER: Voice AI SDK
Open SDK for voice agents in just 4 lines of code. Supports Python and TypeScript, MIT licensed.
★ 274 · PythonAGNIX — Linter for AI Assistants
Validate CLAUDE.md, AGENTS.md, SKILL.md, hooks, and MCP with auto-fixes. Plugin for all popular IDEs.
★ 274 · RustLLMTRIM: LLM Request Compression
A local proxy that cuts tokens in LLM requests without altering responses, saving up to 31% of input and 74% of output tokens.
★ 274 · RustOPEN YOUR AI ASSISTANT
OpenProgram — a self-programming AI assistant that captures, automates, and improves any workflows.
★ 274 · PythonNEURALGRAFFITI: LIVE LLM OUTPUT CONTROL
NeuralGraffiti is a tool for live transformation of foundation model outputs directly at the neural network level. Works in real time without retraining.
★ 274 · Jupyter NotebookLIVING AGENT ORGANISM IN LISP
nodecode is a framework for autonomous AI agents in Common Lisp. Implements a "living organism" concept: the agent plans, writes code, runs tests, and fixes errors in a l
★ 273 · Common LispFREECAD AI: Fast 3D Modeling
AI assistant for FreeCAD converts natural language commands into ready 3D models, saving design time.
★ 272 · PythonBEST LLM OPS LIST
A selection of the most useful tools for LLMOps: from experiments to production.
★ 272 · PythonMULTIMODAL DECISION MODEL
OneJev — multimodal System One model for calibrated answers to questions about screens, photos, video and text in one forward pass.
★ 272 · PythonHYPERLOOM AUTO-OPTIMIZATION LLM ON AMD
Hyperloom — agentic system that automatically optimizes LLM workloads on AMD GPUs by selecting kernels and tuning parameters for peak performance without manual setup.
★ 271 · PythonCLAUDE CODE SAVES YOUR MONEY
Fixes the prompt cache regression in Claude Code that caused costs to rise up to 20x when resuming sessions.
★ 270 · JavaScriptTINYCORTEX: YOUR SECOND BRAIN AI
TinyCortex is an ultra-fast AI memory model that works like your second brain. Written in Rust, it provides instant access to knowledge and supports a local-first approac
★ 270 · RustAI AGENTS ON YOUR OWN SERVERS
Open-source platform to run AI agents on your own servers. Supports shared chat, RAG, skills, real browser, 4700+ MCP servers, budgets and audit. Alternative to ChatGPT E
★ 270 · PythonTOOLKIT FOR LLM EXPERIMENT REPRODUCIBILITY
ReproLLM automates LLM experiment reproduction: fixes environment, dependencies, and configurations. The tool creates deterministic runs and saves artifacts for exact res
★ 270 · PythonAutoRedTeam-Orchestrator - AUTOMATE PENTESTS WITH AI
Modular platform for authorized testing and self-audit of the attack surface via MCP, generating SARIF for GitHub Code Scanning.
★ 269 · PythonLIVE WORD EDITOR DOCUMENTS
word-mcp-live — the only MCP server that edits open Word documents in real time. 114 tools, live editing, tracked changes, and per‑action undo of any operation.
★ 269 · PythonLINEARIS CLI FOR LINEAR.APP
CLI utility for Linear.app with JSON output, smart ID resolution, and optimized GraphQL queries. Ideal for LLM agents and anyone who loves structured data.
★ 268 · TypeScriptLLAMA_ROS ROS 2 LLM
The project combines llama.cpp and llava.cpp with ROS 2, allowing the use of GGUF models for real-time robotics.
★ 268 · C++TORCHSPEC SPECULATIVE DECODING
PyTorch library for training speculative decoding models, accelerating text generation.
★ 268 · PythonDEEPEYE - AUTONOMOUS DATA AGENT
DeepEye — a Python-based autonomous agent that independently analyzes data, builds models, and generates insights without human involvement.
★ 267 · PythonCOLLECTION OF FREE AI MODELS
Daily‑updated list of free AI models (LLM API), ranked by quality with live status. A single OpenAI‑compatible endpoint automatically routes requests to the best availabl
★ 267 · JavaScriptTiny Lossless Coding Agent Harness
A 7 MB lossless coding-agent harness for shell, CI, and local models with no TUI and no silent context cuts.
★ 267 · GoUNIVERSAL LLM CLIENT
Unified client for working with 142+ LLM providers in 11 languages. All at hand.
★ 266 · RustLLMKUBE: LLM IN KUBERNETES
LLMKube - Kubernetes operator for LLM inference on heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, Apple Silicon Metal. Supports llama.cpp, vLLm, TGI, mlx-server, multi
★ 266 · GoRUST CODING AGENT FOR TERMINAL
pi-rust — native Rust framework for AI coding agents. Library-first design, composable LLM providers, tools, sessions, and plugin ABI. CLI inspired by Pi project.
★ 266 · RustREDDIT-RESEARCH-MCP - TURN REDDIT CHAOS INTO STRUCTURED INSIGHTS
MCP server turns Reddit data into structured insights with full citations, enabling semantic search across 20k+ subreddits without installation.
★ 265 · PythonLIVING AI OFFICE ON DESKTOP
AI agents work right on your desktop — walk, communicate, delegate tasks and hold meetings. Support for Claude, GPT, GLM and other LLMs. Integration with Telegram, Discor
★ 265 · JavaScriptWHYBUDDY - AI Team
WhyBuddy — AI agents ask the right questions, draft a plan and specification, and assess feasibility of your idea in minutes.
★ 264 · TypeScriptMAGDA-CORE: MUSIC WITH AI
Magda‑Core is an open ecosystem for music production built on C++20. It supports AI agents, cross‑platform audio plugins and integration with any DAW. 202 stars on GitHub
★ 264 · C++TOMC: CONTEXT AND MEMORY FOR LLM
TOMC compresses CPU context and stores task memory for Codex, Claude Code, Cursor, and other MCP clients. Extends context window without quality loss. 204★ on GitHub.
★ 264 · PythonIX - Instant Code Understanding
System intelligence for code bases. Helps people and AI instantly understand any project.
★ 263 · TypeScriptORLA - ULTRAFAST AGENT ENGINE
Orla — a high-performance execution engine for agent workflows on Go, providing low latency and scalability.
★ 263 · GoGO-AGENT: AI Framework for Go
Multi-agent framework for Go with graph memory, native UTCP tools, and multi-agent orchestration. Ready for production.
★ 263 · GoNEXTCLAW: LOCAL AI WORK
Local AI workspace for agents, skills, files, browser tools, and automations. All in one TypeScript project.
★ 263 · TypeScriptAI-DJ: Live Beat
ai-dj is a standalone plugin with Ableton Link and VST3/AU, 8 tracks and 8 AI models for live improvisation. It sometimes hallucinates, but creativity remains yours.
★ 263 · C++ESP32 VOICE ASSISTANT AI
esp32-thinks is a voice assistant for ESP32 with wake‑word or button, compatible with any OpenAI‑like backend (STT/Chat/TTS). Streaming responses work out‑of‑the‑box than
★ 263 · ShellQUANTUMBYTE – CREATE APPS INSTANTLY
Quantumbyte is an open-source engine for building apps from intentions in Python. Turn ideas into a working product in minutes.
★ 262 · PythonUNDEFINED — QQ Cognitive Bot
Platform for creating QQ bots with cognitive memory and multi-agent skills via OneBot V11.
★ 262 · PythonOPENAI PYTHON WITH X402 PAYMENT
The openai-python library is a drop‑in replacement for the official OpenAI SDK on Python, adding transparent payment via the x402 protocol. It supports agents, Ethereum a
★ 262 · PythonUNIFIED GATEWAY TO AI MODELS
llm7.io provides a single API gateway to dozens of AI models from OpenAI, Anthropic, Cohere and others. A unified interface lets you switch between providers, ensures fal
★ 262 · TypeScriptSWE-BENCH LIVE: EVALUATE LLMS IN CODING
SWE-bench Live — benchmark for evaluating AI agents on real GitHub issues. Automated code verification and comparison of any models.
★ 262 · PythonJEV4PG: NL2SQL FOR POSTGRESQL
Project implements JEV-based natural language to SQL for PostgreSQL. Optimized cost and latency, native execution and parallel plans. Preview: explainable embeddings and
★ 262 · PythonAGENT SECOND BRAIN SERVER
You send voice notes to Telegram — you get a knowledge base, tasks in Todoist, and reports. Memory with Ebbinghaus forgetting curve and a knowledge graph.
★ 261 · PythonLANGFAR LLM Bias
A Python library for evaluating LLM bias and fairness at the level of specific use cases.
★ 261 · PythonCODEX DEGRADATION DETECTOR
Tool for tracking shrinkflation in Codex. Runs tests and compares response quality against baseline, detecting hidden model degradation.
★ 261 · PythonAI LINUX ADMINISTRATOR IN RUST
Sysknife is an agent for Linux administration. The model picks the action; the daemon builds the command. All actions require approval and are logged with Ed25519 signatu
★ 261 · RustRAGPI – AI Assistant for Documents
An open AI assistant that answers questions using your own documents. Easy to install and configure in Python.
★ 260 · PythonDECLARATIVE LLM PROGRAMS FOR ELIXIR
imp brings DSPy approach to Elixir: declaratively define LLM pipelines, framework auto-optimizes prompts and weights. Runs on BEAM, supports agents and self-improvement w
★ 260 · ElixirDESKTOP AI AGENT WITH 33 ADAPTERS
WeWorker — open-source desktop AI agent performing real actions on websites. 33 adapters connect mail, shopping, social networks and other services. Written in JavaScript
★ 260 · JavaScriptINPUT0 - VOICE INPUT FOR MACOS
Hold the hotkey — speak, release — text is already inserted. Local STT + LLM enhancement via Rust.
★ 259 · RustCorvid-lang - CHECK AI BEFORE LAUNCH
Corvid-lang is a Rust language that statically checks AI code before launch, guaranteeing safety and no runtime errors.
★ 258 · RustSPEC‑DRIVEN AI WORKFLOW
Autonomous workflow for AI agents: reconnaissance → plan → build → validation → release with TDD, adversarial validation, and anti‑slop quality gates. Packaged as Kiro Po
★ 258 · ShellNew projects on this topic in Telegram
Telegram →