LLM: open-source projects on GitHub
2095 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
FREEBUCKS PROXY: CODING GATEWAY
Multi-account OpenAI‑compatible gateway for coding models. Supports pooled keys, session lifecycle management, TLS stealth, and an embedded admin dashboard. Works without
★ 297 · GoGPU BY TURN WITHOUT CRASHES
Berth leases the GPU to chat, image, and voice engines in turn. Two processes never load together and crash each other. Single Go binary, no dependencies.
★ 297 · GoMCP SERVER FOR STRANDS AGENTS
MCP server that provides Strands Agents documentation to your AI tools for easy agent coding.
★ 296 · PythonTURBO LLM: OFFLINE WITH AI
Run any local LLM with automatic GPU tuning, a web UI, and an OpenAI/Anthropic‑compatible API.
★ 296 · TypeScriptLLM-X: THE SIMPLEST WEB-UI
LLMX — the simplest web interface for local LLMs, running directly in the browser. Supports chat bots, integration with Automatic1111, and quick start without complex set
★ 296 · TypeScriptMANAGE MCP SERVERS IN CLAUDE
mcp-manager — a web UI on React and Vite to manage MCP servers in Claude. Allows adding, removing, and configuring context protocol servers without editing configs. The p
★ 296 · TypeScriptGOLEMBOT — AGENT EVERYWHERE
Connect any AI agent to any messenger and LLM provider. Cursor, Claude Code, Codex work in Slack, Telegram, Discord and even WeChat.
★ 295 · TypeScriptAWESOME RAG PRODUCTION
List of proven tools and practices for building scalable RAG systems in Python.
★ 295 · PythonJITLLM: HIGH PERFORMANCE LLM ON JVM
JITLLM — Java framework for high‑performance LLM inference and serving on the JVM. Supports GPU acceleration, GGUF and quantized model formats, and integration with DeepS
★ 295 · JavaOPEN AI-AGENT FOR DESKTOP
OpenGhost — open AI‑agent for desktop on JavaScript. It has its own agent engine, browser automation tools and a drawing engine that visualizes its explanations. Supports
★ 295 · JavaScript9ROUTER-GO GATEWAY FOR LLM ROUTING
A high‑performance Go proxy routes LLM requests to Claude, DeepSeek, GPT and other models. It delivers up to 32 000 RPS at only 42 MB RAM, is CGO‑free, and supports flexi
★ 295 · GoEZDATA AI DATA PLATFORM
AI-native platform with 60+ connectors, dlt‑based ETL, DAG scheduler, and sandbox agents for queries, charts, and data analysis.
★ 294 · PythonAI BOT FOR DISCORD WITH TYPESCRIPT
TypeScript Discord bot with Ollama integration for LLM and Stable Diffusion for image generation. Supports dialogue context, prompt system and attachment handling. 294 st
★ 294 · TypeScriptCEVAHIR AI OPEN AI ENGINE
Full-featured open-source engine for training tokenizers, transformers, and cognitive reasoning, ready for chat flow.
★ 293 · PythonIVA-AGENT YOURAI ASSISTANT
IVA-agent is a self-contained AI assistant in Telegram that stores all your information and helps you manage everyday tasks. It launches with a single command, runs fully
★ 292 · TypeScriptREPOMINDS: CHAT WITH CODE
AI assistant for interacting with any public GitHub repository: code analysis, architectural maps, and security audit.
★ 291 · TypeScriptAI-GATEWAY: Unified LLM Gateway
Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.
★ 291 · GoOFFLINE LLM ON ANDROID: FULL PRIVACY
OfflineLLM runs any GGUF models locally via llama.cpp with ARM optimisation. Zero network permissions: encrypted settings, biometric lock, and tamper detection. Supports
★ 291 · KotlinLOCAL LLM RAG: QUICK START
Run local language models and perform retrieval-augmented generation without the cloud.
★ 290 · PythonLLAMA GITHUB AI AGENT
A library for LLM agents that extracts context from selected GitHub projects and answers code questions.
★ 290 · PythonAETHERLINK AI for All Models
Cross-platform AI assistant supporting OpenAI, Gemini, Claude, and other models. 293 stars on GitHub.
★ 289 · TypeScriptMEMORY FOR AI AGENTS
Local persistent memory for Claude Code, Cursor, and Codex via MCP. Solutions, lessons, and facts are stored in a single SQLite file — fully offline and multilingual.
★ 289 · PythonMARKMAP MCP SERVER FOR MARKDOWN
Converts Markdown into interactive mind maps with export to PNG, JPG, SVG.
★ 289 · TypeScriptBLACK BOX FOR AI CODE
brain0 links every commit to agent prompts. Detects drift, audits agent data access (DLP), assesses risk from evidence, stores MCP memory, and emits signed provenance att
★ 289 · RustAI Engineer Interview Prep Kit
Curated interview questions, study maps, and coding challenges for AI/LLM engineering roles with company-specific sets and worked solutions.
★ 289 · PythonUTEKE: BRAIN FOR AI
Local memory for AI agents: semantic search, storage and recall of memories in one Rust binary with no configuration.
★ 288 · RustMIMEO: TURN ANY EXPERT INTO AN AGENT
Create AGENT.md and SKILL.md from expert knowledge in your repository. Mimeo analyzes code, documentation, and practices, turning them into instructions for AI agents. Su
★ 288 · PythonBOCOEL: BAYESIAN OPTIMIZATION FOR LLM
bocoel — a Bayesian Optimization framework for quick LLM evaluation: 10× faster, just a few lines of code. It replaces costly benchmarks with precise search over model hy
★ 288 · PythonPOSTHORSE: CONTEXT WITHOUT SUMMARY
Posthorse provides native context windows without summarization for the fitchmultz/pi fork of the Pi coding agent enabling rollover tools, durable notes, and history reco
★ 288 · TypeScriptJAX-LLM-EXAMPLES - QUICK START
Minimal code, maximum speed: LLM examples in pure JAX for rapid prototyping.
★ 287 · PythonAGENT ORCHESTRATOR AXEL
Rust framework for orchestrating LLM agents in Rex ecosystem. Manages worktrees, integrates with Claude Code and Codex. 210★ on GitHub.
★ 287 · RustBOSUN: AUTONOMOUS ENGINEERING
Bosun is a JavaScript framework for autonomous engineering agents that uses LLMs such as GPT‑4, Claude and Codex. It automates writing, testing and refactoring code, inte
★ 286 · JavaScriptLLM WEB SEARCH IN OOBABOOGA
Extension for oobabooga/text-generation-webui adding LLM web search via DuckDuckGo. Uses FAISS for result indexing.
★ 286 · PythonSTOCK ANALYSIS SKILLS FOR LLMS
InvestSkill gives LLMs (Claude, Gemini) tools for fundamental analysis of US stocks. The JavaScript project includes agents for fetching financial data and calculating mu
★ 285 · JavaScriptDOCUMENT TRANSLATOR AI IN PYTHON
DocTranslator is a powerful AI document translation tool. It supports multiple file formats, OpenAI API, batch processing, multithreading, and Docker deployment for fast
★ 285 · PythonDATASETS FOR AI IN HOME ASSISTANT
A collection of datasets for evaluating AI models in the context of a smart home. 222 stars.
★ 284 · Jupyter NotebookNot a Llama, no stance
Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.
★ 284 · GoKairon AI Platform
Create proactive digital assistants via Visual LLM chains. Fully written in Python — an open and accessible project.
★ 284 · PythonSICO — NEXT-GENERATION DIGITAL WORKER
Open Digital Worker platform for reliable task execution, continuous co-evolution of AI agents, and building Enterprise AI solutions.
★ 284 · PythonMULTI-PROMPT FOR LLM ON DESKTOP
llm-god — a desktop app built with Electron/TypeScript that lets you send simultaneous requests to ChatGPT, Gemini, Claude and DeepSeek. Compare answers in real time, sav
★ 284 · TypeScriptTAIR-KVCACHE: ACCELERATING LLM INFERENCE
A high-performance KV caching system from Alibaba Cloud that accelerates LLM inference.
★ 283 · C++MONET: Claude Management
Native app for managing Claude Code sessions: view, search, and control code straight from your desktop.
★ 283 · RustFINNTS: Financial Forecast in R
Microsoft FinnTS framework for accurate forecasting of financial time series using parallel computing in the cloud.
★ 283 · RMNEMORY: MEMORY FOR AI AGENTS
Self-hosted, secure, feature-rich memory for AI agents and assistants. Extracts facts intelligently, removes duplicates and stores artifacts with full content.
★ 283 · PythonSEARCHARVESTER: AI AGENT SEARCH AND FETCH
Self‑hosted search engine based on SearXNG (100+ sources) with FastAPI and trafilatura. Tavily‑compatible /search and /extract endpoints with size limits and pagination,
★ 283 · PythonBEST LLM SERVICES LIST
A collection of ready-to-deploy LLM services with open-source code in TypeScript.
★ 281 · TypeScriptTHREE WS: 3D AI AGENT
Open-source 3D AI agent framework: GLB/glTF avatars with LLM brain, memory, emotions and autonomous payments. Supports MCP server, x402, Solana/EVM, Three.js, embeddable
★ 281 · JavaScriptSNIP - TOKEN SAVINGS UP TO 90%
Go-based CLI proxy that reduces LLM token usage by 60-90% with YAML filters for Claude Code, Cursor, Copilot, and Gemini.
★ 280 · GoSAGENTS: AI Agents in Elixir
The sagents project allows creating interactive AI agents in Elixir with OTP supervision, middleware, and Phoenix LiveView integration.
★ 280 · ElixirRESEARCHCLAWBENCH - IMPROVING AI RESEARCH EFFECTIVENESS
Evaluation of automated AI agents: from rediscovery to new discoveries. Runs in Jupyter Notebook.
★ 280 · Jupyter NotebookSECURITYCLAW AUTONOMOUS SOC AGENT
Modular SOC agent on Python, monitors OpenSearch/Elasticsearch, builds RAG memory and validates anomalies with LLMs.
★ 280 · Pythonphi - Simple Phi-4 Launch
Run the powerful multimodal Phi-4 model directly on your Mac with Apple Silicon — no cloud, no complex setup.
★ 280 · Jupyter NotebookAGENTARK: ONE LLM INSTEAD OF MANY AGENTS
Official AgentArk implementation from CMU and Georgia Tech. Method distills multi-agent intelligence into a single LLM agent preserving task quality. Python code, 260 Git
★ 280 · Pythonopen-agent - FREE AGENT FOR ALL
open-agent offers 60+ models, free plans, local LLMs and a Docker sandbox — your agent, your rules.
★ 279 · TypeScriptOfficial Pinecone TS Client
Official TypeScript client for Pinecone vector database. Simple integration and full API support.
★ 279 · TypeScriptLLM AGENTS IN SCALA
llm4s is a library for building LLM agents in Scala with type safety. Supports Anthropic, Gemini, and Java interop. 272 stars on GitHub.
★ 279 · ScalaMONITOR-GUIDED DECODING FOR CODE LLM
NeurIPS 2023 artifact: Monitor-Guided Decoding of code LMs with static analysis of repository context. Includes multispy — Python LSP client for language server integrati
★ 279 · PythonDecision-Based Knowledge Graph Builder
Builds governed knowledge graphs from documents using decision models, with every fact traceable to source evidence.
★ 279 · PythonGOGOGOT: AI AGENT ON GO
GoGogot — lightweight self‑hosted AI agent in Go that you can run locally and use instead of OpenClaw. It understands natural instructions, executes bash commands, works
★ 278 · GoBUILD YOUR AI INTRANET
Autonomous grid unites your computers into a single infrastructure for running AI models: training, fine‑tuning and inference. Supports distributed computing, fine‑tuning
★ 278 · PythonNew projects on this topic in Telegram
Telegram →