LLM: open-source projects on GitHub
2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
COTABBY AI AutoComplete Mac
Local AI autocomplete for your entire Mac — works offline everywhere you type, with open-source Swift code.
★ 395 · SwiftOPEN-WEBUI-FUNCTIONS: AI Extensions
A collection of pipelines and filters for Open WebUI that enables connecting Azure AI, N8N, Gemini and automating queries.
★ 395 · PythonLOCAL MCP CONTROL PLANE FOR WEB AI
Local MCP controller connecting web assistants to files, terminal, and Git. Executes tools on user machine with permission control.
★ 395 · TypeScriptEDDI: AI Agents from JSON
Quarkus engine turns JSON into ready AI agents with support for 12+ LLM, RAG, and enterprise security.
★ 394 · JavaCOMPANION FOR SYSTEM DESIGN
Free open-source repository supplementing the Grokking the System Design Interview course. Materials and examples for preparing for system design.
★ 394Prompt Hacking Course
The most complete course on prompt engineering and LLM attacks: from basics to advanced hacking and defense techniques.
★ 394 · Jupyter NotebookStreaming Markdown for iOS
A fast library for rendering Markdown with streaming support. Ideal for iOS apps.
★ 393 · SwiftCODEXLOOM Domain Agents
Transform Codex chains into resilient agents that operate seamlessly in your domain.
★ 393 · GoCRIT - IMPROVE YOUR FEEDBACK LOOP
Crit is a tool for fast feedback with an AI agent, simplifying development and testing of code.
★ 392 · GoAGENTIC AI ENGINEERING: PRACTICES, EXAMPLES
Practical guide to creating AI agents from scratch: LLM API, prompt engineering, tool calling, agent loop.
★ 392 · PythonCUSTOMIZATION LLM VIA LOGITSPROCESSOR
A set of LogitsProcessors for LLM behavior tuning. Solves specific tasks without changing model architecture.
★ 392 · PythonSAFE AI CODE IN CONTAINERS
Run OpenCode, Codex, and Claude Code with full privileges in an isolated environment. Security and flexibility in one solution.
★ 391 · TypeScriptOSPEC: Agentic Workflow for AI
Spec‑oriented framework for agentic AI agents: turns a request into a verifiable plan‑act‑check loop.
★ 391 · JavaScriptChatGPT Subtitle Translator
Tool translates video subtitles using ChatGPT or any compatible LLM API. Fast, accurate, and with no complex installation.
★ 391 · JavaScriptLLMstudio - Simple LLM Production
LLMstudio is a framework for fast deployment of LLM applications in production, simplifying deployment and scaling.
★ 391 · PythonAIKON CHATBOT ON NOKIA
J2ME application for Nokia S40/S60 that connects an old phone to modern LLMs: Claude, ChatGPT, Gemini and Grok. Built-in tiny Go server handles data exchange over HTTP. T
★ 391 · JavaRUST FRAMEWORK FOR AGENTS
High‑performance Rust framework for building interactive workflow systems. Supports complex chains and multi‑agent systems with low latency.
★ 390 · RustDIRGE: Dynamic Intent Resolver
A Rust engine for dynamic Intent resolution improves AI-agent accuracy.
★ 389 · RustARENO: Accelerate RL Single Node
ARENO simplifies scaling post-training RL on a single node, delivering high speed with minimal setup.
★ 389 · PythonHarnessClaw Engine for AI
An engine for LLM assistants in Go, supporting WebSocket, multi-turn dialogues, tool calls, permission management, and skill extensions.
★ 388 · GoPATINA: AI PATTERN REMOVAL
Patina finds and rewrites AI text patterns in four languages. Works as a skill for Claude Code, Codex CLI, Cursor, OpenCode and as a Node.js CLI.
★ 388 · JavaScriptTokentelemetry: AI Agent Dashboard
Local token telemetry dashboard for AI agents: tracks usage, sessions, tool calls, and reasoning chains in Hermes and Claude Code.
★ 388 · PythonPARSE CODE FOR AI
The ingest project lets you quickly extract code from repositories and websites, sending the result to the clipboard or a file for further AI processing.
★ 388 · GoBASE: AI OPERATING SYSTEM
BASE turns Claude Code from a one-shot tool into a workspace that remembers context, self-maintains, and never gets stale. This is Builder's Automated State Engine in Rus
★ 388 · RustUniversal Exam Skill
Transforms slides, notes, and past work into a structured knowledge base and test bank, training only on your materials without fabrication. Bilingual EN/中文.
★ 387 · PythonSEC EDGAR MCP: Data Server
A Model Context Protocol server for accessing SEC EDGAR data via the standard MCP interface. Enables integrating financial reports into AI agents.
★ 387 · PythonUSEAGENT — AI COWORKER FOR TEAM
useagent — AI coworker for your team: agent provides cloud environment, access to tools and context, returns websites, presentations, spreadsheets, reports and pull reque
★ 387 · TypeScriptCOMPILE POLICIES INTO DECISION DATA
Tool to turn organizational policies and rules into verifiable training data for AI agents. Every label traces back to its source rule and document.
★ 387 · PythonDANCE WITH LLM IN CODE
Minuet-ai.el provides real-time code completion from LLMs (OpenAI, Gemini, Claude, Ollama, etc.) directly in Emacs.
★ 386 · Emacs LispOPEN AI ANALYST ON E2B
Open source AI analyst on E2B analyzes CSV files via Llama 3.1 and builds interactive charts. Written in TypeScript, it already has 384★.
★ 386 · TypeScriptOpenLake: GPU Storage
Ultra-efficient storage for GPU workloads. Deliver data at lightning speed.
★ 385 · RustPI HARNESS: FULL AGENT
Pi‑Harness — the operational superset of Pi Coding Agent: it retains all its capabilities and adds observability, governance, recovery, evaluation and orchestration of mu
★ 385 · TypeScriptFREE AI TOOLKIT
Python toolkit with 40+ free AI providers, web search, and digital utilities in one place.
★ 383 · PythonAUTOMATIC VIDEO UPLOAD
AI pipeline creates educational videos using Gemini and automatically uploads them to YouTube — from idea to publication without human intervention.
★ 383 · PythonPREDIKIT - CONNECT MODELS TO AGENTS
Predikit connects ML models with AI agents, simplifying integration and accelerating development of intelligent systems.
★ 382 · PythonPRISMOS AI: Local Agent
PrismOS — a local agentic AI OS built on Rust, Tauri, and React, providing full privacy and multi-agent collaboration without the cloud.
★ 382 · RustSTUDIO: MANAGE AGENTS
Open-source control plane for AI agents: connect tools, hire agents, and track every token and dollar.
★ 381 · TypeScriptAI NPCS IN SKYRIM: VOICE AND MEMORY
SkyrimNet-GamePlugin adds NPCs with LLM: they speak, remember dialogues, react to actions, and are voiced in real time. 364 stars on GitHub.
★ 380 · PapyrusLLAMAMPERE: LLM ACCELERATION ON RTX 3090
llama.cpp fork optimized for Ampere GPUs. Delivers 110+ tok/s on Qwen 3.8 at 100K context. Runs on 12 GB VRAM with 200K+ context.
★ 380 · C++VERA: LANGUAGE FOR LLM
Vera — a language for LLMs so models can write code. In Python, already 379 stars.
★ 379 · PythonAI AUTOMATION FOR CISCO PACKET TRACER
Describe a network in natural language — MCP-Packet-Tracer generates, validates and deploys full topologies with OSPF, EIGRP, RIP and DHCP. 323 stars on GitHub.
★ 379 · PythonCURATED RESOURCES FOR MLLM
Awesome_Multimodel_LLM — curated collection for multimodal LLM: datasets, fine-tuning, visual reasoning, in-context learning. 379★ on GitHub. All latest MLLM resources in
★ 379Haystack Tutorials: Quick Start
A collection of Jupyter notebooks with step-by-step guides for Haystack: from basics to advanced RAG pipelines.
★ 378 · Jupyter NotebookDODAIOS: YOUR AI ASSISTANT
Dodaios — a local open‑source AI assistant that runs your agents, coding CLI, browser and any apps. It works on Windows, macOS and Linux, is written in Python and already
★ 378 · PythonOPENCHART: TRADING PLATFORM WITH AI
OpenChart - an open-source trading workspace in TypeScript where you can plug in your AI agents and analyze markets with interactive Chart.js charts. It supports exchange
★ 377 · TypeScriptCONTEXERE: CONTEXT LAYER FOR AI
Contexere (formerly OMNI) — context layer for AI coding agents. Compresses context by removing noise and saving tokens without information loss. Written in Rust, works vi
★ 377 · RustLLM REASONING VIA Z3 THEOREM PROVING
Project combines LLM and Z3 for formal reasoning verification. Supports SMT2 and JSON DSL backends. 377 stars on GitHub.
★ 377 · PythonOPEN SOURCE CODING AGENT FOR TERMINAL
Codai — open-source coding agent in C#, runs directly in terminal. Supports Claude and ChatGPT, 374 GitHub stars.
★ 376 · C#YOAGENT: AGENT ON RUST
Yoagent is a Rust agent loop that streams data from seven LLM protocols, runs tools and repeats the process until the task is complete. It supports Anthropic Claude, Open
★ 375 · RustStatsPAI: AI Agents for Causal Analysis
The first agent-native Python library for causal inference and econometrics with a unified API, MCP server, and validation on R and Stata.
★ 374 · PythonSTRIX HALO LLM Setup
Guide for LLM on Ryzen AI MAX+ 395 and Radeon 8060S via Ollama, llama.cpp and ROCm. Achieving 100 tokens/s 30B Qwen and 140 tokens/s CHADROCK MTP.
★ 373 · PythonBUILD LLM IN SECONDS
CLI tool creates ready-to-train PyTorch projects for LLM in seconds. Analog of create‑next‑app, but for language models. Written in TypeScript, already has 362 stars.
★ 373 · TypeScriptBOLTMCP - NEW TOOL FOR AI
Shell project for integrating MCP servers with AI agents. Simplifies configuration and running models in a local environment.
★ 372 · ShellYAMS — MEMORY FOR LLM
Persistent storage for LLM and applications: a content‑addressable DB with deduplication, compression, full‑text and vector search.
★ 372 · C++AI CODE REVIEW IN PR
genai-code-review — GitHub Action that uses an LLM to analyze diff in pull request and posts comments. Just add a step to your workflow, specify the API key and choose a
★ 372 · PythonMANGA TRANSLATOR ON AI
MangaTranslator — a Python application that uses AI for automatic manga translation. It recognizes text in speech bubbles, translates it via LLM, and neatly inserts the t
★ 372 · PythonGIT DIFF THROUGH SENIOR EYES
diff-tour — TUI for step-by-step git diff walkthrough. Turns changes into a guided tour with code-review style comments. Written in Go, 342 stars.
★ 372 · GoSUPER GRAPH FOR LLM
102K+ node LLM-wiki graph, 91K skills and 10K MCP harnesses for Claude Code and custom LLMs with execution recommendations.
★ 371 · PythonVUE IN TERMINAL? YES!
Framework for creating terminal interfaces with Vue, supporting SFC, JSX, and Yoga flexbox. Includes HMR and testing out of the box.
★ 370 · TypeScriptTEMPLATE GENAIOPS PROMPT FLOW
Template GenAIOps with Prompt Flow simplifies creation of LLM applications through centralized hosting, lifecycle management, and experiments with prompt variants and hyp
★ 370 · PythonNew projects on this topic in Telegram
Telegram →