LLM: open-source projects on GitHub
2095 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
ZOTSEEK AI SEARCH IN ZOTERO
ZotSeek adds semantic search to your Zotero library using vector embeddings. The built-in MCP server lets you connect Claude Code and Codex as AI agents for meaning‑based
★ 239 · TypeScriptSELF-EVOLVING INFRASTRUCTURE FOR PHYSICAL AI
rosclaw — runtime for embedding AI agents into robot bodies. Supports e-URDF, safety sandbox, capability routing, praxis capture, physical memory, and skill evolution. 20
★ 239 · PythonLLM Bug-Sweeping Benchmark
A Python benchmark that measures how many bugs LLMs can detect and fix across large codebases.
★ 239 · PythonRED-TEAMING AI AGENTS IN PYTHON
Humanbound — adversarial testing engine, SDK, and CLI for AI agents. Runs locally or via Humanbound Platform. 218 stars on GitHub.
★ 239 · PythonADHD — Skill for Coding Agents
Tree of thoughts with dead‑end branch pruning. Parallel reasoning in multiple cognitive frameworks built on Claude Agent SDK.
★ 238 · TypeScriptBEACON-SKILL: AGENT PINGS
Library for exchanging messages between AI agents with support for RTC values and UDP bus. Easy integration into multi-agent systems.
★ 238 · PythonSERVICENOW MCP: AI TOOL
An open TypeScript server with 450+ tools and 26 AI capabilities for Claude, ChatGPT, and others, supporting stdio, SSE, HTTP, and A2A.
★ 238 · TypeScriptPULSAR — ULTRAFAST MOE INFERENCE
Pulsar — an SSD-streaming engine for giant MoE models on Rust+CUDA.
★ 238 · RustAMD Strix Halo Inference Engine
Kyojin runs ExLlamaV3 on AMD Strix Halo (ROCm gfx1151) to execute 300B‑parameter Mixture‑of‑Experts models on a single 128 GB mini PC.
★ 238 · PythonTERRAPOD: FREE TERRAFORM ALTERNATIVE
Terrapod is an open-source replacement for Terraform Enterprise written in Python, enabling infrastructure-as-code management without licenses.
★ 237 · PythonUNBIASEDSTRATA — CLEAN STRATA WITHOUT BLOAT
Simplified Strata fork for LLM. Clone, rsync to prod, compile — done. No extra dependencies or configs.
★ 237 · C++LLAMA_CPP.RB Ruby Bindings
Ruby wrapper for llama.cpp, allowing you to run large language models directly from Ruby code.
★ 236 · Carksim - DETECT AGENT ERRORS
arksim helps developers find errors in AI agents before they reach real users, saving time and improving reliability.
★ 236 · PythonTRANSFORMER-TRICKS - ACCELERATING TRANSFORMERS
A collection of techniques and utilities for accelerating transformers: attention optimization, quantization, and caching of computations.
★ 236 · TeXHOMELAB MONITOR DASHBOARD
Plug‑and‑play dashboard for homelab in a single container: monitoring GPU, local‑AI VRAM, Docker, systemd and host health. Built‑in read‑only MCP server gives AI agents a
★ 236 · PythonANIMAWORKS: AGENT CODE
Autonomous AI agents with brain-like memory: they grow, consolidate, and forget. Supports Claude, Codex, Gemini, Cursor, and Ollama.
★ 235 · PythonM.I.L.E.S AI VOICE ASSISTANT
Voice assistant powered by GPT-4‑Turbo: self‑adjusting prompt, Spotify control, calculations, web search, weather, and long‑term memory.
★ 235 · PythonLong-Term Memory for AI
Open-source vector-free long-term memory engine for AI agents, delivering SOTA results on LoCoMo and LongMemEval with substantial context reduction.
★ 234 · PythonSUPERPOWERS CLAUDE CODE FOR SYMFONY
Claude Code plugin for Symfony 7.4 LTS and 8.x adds 44 skills, 7 AI subagents and 13 commands for working with API Platform, Doctrine ORM, testing Pest/PHPUnit, Messenger
★ 234 · TypeScriptNATIVE PGVECTOR FOR WINDOWS
Native pgvector build for PostgreSQL on Windows. Vector search and ANN indexes for LLM and RAG without Docker or WSL.
★ 234AI AGENT FOR OSINT INVESTIGATIONS
AI-powered OSINT agent with REPL, MCP server, and CLI; 9 tools compatible with Claude, GPT-4, and local models, 233 stars on Python.
★ 233 · PythonAMUX: Multiplexer for AI Code
amux launches dozens of parallel Claude Code agents in tmux without supervision. Set it up once and enjoy autonomous AI coding.
★ 233 · HTMLJANGQ Quantization for Apple Silicon
JANG — adaptive mixed-precision quantization of GGUF models for MLX on Apple Silicon. Requires using the JANG_Q runtime for maximum performance.
★ 233 · PythonHUB: RUST LLM GATEWAY
High-scale LLM gateway in Rust with built-in observability via OpenTelemetry. Easily scalable and production-ready.
★ 233 · RustREMNIC: MEMORY FOR AI AGENTS
remnic — open‑source memory layer for AI agents: scoped memory with provenance, search quality control and auto‑correction, plus boundaries, evals and MCP/HTTP access. En
★ 233 · TypeScriptDEEPSEEKER: PROXY FOR LLM API.
Use your own DeepSeek account via API compatible with OpenAI and Anthropic. FastAPI proxy enables tool calling, computer vision and streaming data transfer.
★ 233 · PythonAI ASSISTANT IN FLOATING BUBBLE
Buddy-android is an open-source AI assistant in a floating bubble. Controls your phone: reads screen, taps, types. Works with Claude Code, Codex, Gemini and Grok without
★ 233 · JavaKnowledge Graph of Thoughts
Official implementation of the Knowledge Graph of Thoughts method, optimizing LLM performance via knowledge graphs.
★ 232 · PythonSUPERMOD: NEW SKILLS
Open agents and tool schemas for Superior Trade – create, test, and deploy strategies on Hyperliquid.
★ 232 · JavaScriptSQUEEZ: AI CLI TOKENS COMPRESSION
squeez — hook‑based token compressor for 7 AI‑CLI hosts. Up to 95% Bash compression,signature mode for code reading and cross‑call deduplication.
★ 232 · RustALL PROMPTS CLAUDE IN ONE
All official Claude prompts in one repository: verbatim, dated and source-linked, from Claude Fable 5.2 to Haiku 3. 23 models from Anthropic's release notes, plus analysi
★ 232 · PythonHEALTHCHAIN: AI FOR MEDICAL DATA
Python SDK that connects AI models to real‑world EHR systems, eliminating complex integration.
★ 231 · PythonSIMPLERLLM: Easy LLM Use
The library simplifies calling LLM via a unified Python interface, supporting popular providers and quick AI integration into projects.
★ 231 · PythonMNEMЕ: CROSS-SESSION AI MEMORY
mneme gives agents long-term memory across sessions. Stores data in SQLite and Markdown, consolidates via autoDream. 4 recall modes: keyword, vector, BM25, entity. Includ
★ 231 · JavaScriptAGENTIC MEMORY FOR DEEPSEEK
deepseek-bot — memory and message gateway for deepseek-harness. Works as a Discord bot on Cordis, giving agents context and chat history. 205 stars on GitHub.
★ 231 · TypeScriptPURE-RUST ENGINE FOR QWEN GGUF
RustingStrata is a pure-Rust inference engine for Qwen GGUF (Qwen3–3.8, MoE up to 770B+). Supports CUDA/Vulkan, hybrid CPU+GPU experts, MTP speculative decoding. Up to 1.
★ 231 · RustMETA-LLM-CHARTER - AI Engineer Rules
Eleven rules and one meta‑rule that turn LLM agents into disciplined lead engineers.
★ 230 · TypeScriptTYPECHAT: Smart C# Chatbot
Typechat.net is a framework for building type‑safe chatbots in C# with LLM integration.
★ 230 · C#VIBE — BOILERPLATE FOR AI APPS
Toolkit for building AI apps on the ibl.ai platform. The iblai-app-cli CLI and @iblai/iblai-js SDK spin up a Next.js project with SSO, chat, profiles, notifications, and
★ 230 · TypeScriptLOCAL OPERATOR: ROUTINE AI AGENTS
Platform for creating a workspace with a team of AI assistants that automate everyday routine tasks.
★ 229 · PythonFAST BROWSER AGENT
fastbrowse — browser agent in Rust. LLM plans actions, Jev executes them on page. Every claim in answer cites a quote from source.
★ 229 · RustUniversal SDK for AI Agents
Composio is an SDK for connecting AI agents to numerous platforms and automation tools.
★ 228 · TypeScriptOPEN GAME WIKI TEMPLATE ON ASTRO
AnvilWiki — free game wiki template on Astro and Cloudflare Pages. Static, zero-JS, with AI-native content workflow. Unlimited bandwidth and 201 stars on GitHub.
★ 228 · TypeScriptCATALOG OF FREE LLM APIS
The project collects legal free APIs for LLMs and coding agents. The list self-updates and is probe-verified twice a week. Only free tiers, no-card trials, and free model
★ 228 · PythonEvolving AI Agent
A personal AI agent with self‑learning and adaptive development.
★ 227 · PythonComfyUI Fal API: 1400+ Models
Production-ready custom nodes for ComfyUI, providing access to 1400+ fal.ai models with automatic updates, caching, and cost control.
★ 227 · PythonCOMMON SKILLS FOR AI AGENTS
Project agents provides shared standards and reusable skills for Claude Code, Codex CLI, and other AI coding agents. It simplifies creating custom skills and ensures comp
★ 227 · PythonVLLM INFERENCE: LOOPED TRANSFORMERS
vllm-rlt — vLLM-style inference engine for looped transformers. Implements loop-level scheduling and execution via composable stages. 207 stars on GitHub.
★ 227 · PythonOCTET: FAST AI AGENT FOR CODING
Rust coding agent with multimodal input support and deep LLM provider integrations. Extensible in any language via JSON-RPC. 207 stars on GitHub.
★ 227 · RustAwesome LLM On-Policy Distillation
A collection of articles and resources on the on‑policy distillation technique for large language models. Suitable for LLM researchers and practitioners.
★ 226 · PythonNAME - OFFICIAL AGENT HUB
Official Telnyx repository for creating AI agents: tools, examples, and documentation in TypeScript.
★ 226 · TypeScriptOMEGA-MEMORY FOR AI AGENTS
Omega-memory provides long-term memory for AI agents, allowing them to store and retrieve code context between sessions.
★ 226 · PythonCOLLECTIVE INTELLIGENCE AI
A collective intelligence engine where tens of thousands of AI models collaborate through diverse coordination strategies.
★ 226 · TypeScriptTOKEN-PRINT 3D VISUALIZATION
Token-Print is an interactive platform for 3D visualization of transformer models, tensors, and real-time LLM inference. It supports loading models from Hugging Face and
★ 226 · TypeScriptLazy AI Agent
The ponytail project makes your AI agent as lazy as possible: it writes only the code that is indispensable, following the principle of a lazy senior developer. This appr
★ 225 · JavaScriptKALAVAI-CLIENT: CLOUD GPU POWER
The project aggregates idle GPU capacity and offers it for distributed computing.
★ 225 · TypeScriptLLAMA2 IN ONE ZIG FILE
The llama2.zig project lets you run Llama 2 inference in a single file using pure Zig, with no dependencies.
★ 225 · ZigBEST AI MATERIALS FOR EDUCATION
A collection of articles and resources on applying LLM in education: from overviews to practical examples.
★ 225 · Jupyter NotebookGAIA-UI AI Agent Components
A set of beautifully styled TypeScript components for quickly creating AI agents. Ideal for developers who value design.
★ 225 · TypeScriptAI BUILDS SAAS FAST
saas-builder is a Python framework where autonomous AI agents build full‑stack applications in minutes.
★ 224 · PythonNew projects on this topic in Telegram
Telegram →