LLM: open-source projects on GitHub
2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
AI browser with agents
Open-source browser with AI agents — an alternative to ChatGPT Atlas, Perplexity Comet, Dia.
★ 10,963 · TypeScriptTYK OPEN AI GATEWAY.
Tyk is an open‑source API and AI gateway that handles REST, GraphQL, TCP, gRPC and MCP traffic. It provides traffic management, authentication, and scalable deployment in
★ 10,886 · GoJina Reader API
Converts any URL into LLM-friendly text using the prefix https://r.jina.ai/
★ 10,837 · TypeScriptCHAT-UI: OPEN AI CHAT
Open-source chat interface underlying HuggingChat, written in TypeScript and already gathered over 10,000 stars.
★ 10,746 · TypeScriptAI Hotspot Tracker
A TypeScript framework that automatically discovers trending topics and generates daily reports; plug in your own data sources and filters to create a custom industry hot
★ 10,693 · TypeScriptCode Editor for AI Agents
Run Claude Code and Codex on your computer. A next‑generation editor for the AI‑agent era.
★ 10,686 · TypeScriptAI Expert Collection
Over 211 AI specialists optimized for 16 tools and 18 departments, with unique agents for the Chinese market.
★ 10,617 · ShellSoup: Train LLM Easily
Soup fine-tunes an LLM from a single YAML using a streaming layer — enabling an 8B model to run on a laptop with 4 GB VRAM.
★ 10,552 · PythonOPEN SOURCE AI FOR LANGUAGES
Read Frog — open-source extension for language learning via immersive translation and flashcards. Immersive Translate alternative with DeepSeek and local LLM support. 10k
★ 10,426 · TypeScriptLocal AI SDK Set
Production-ready toolkit for running AI models on a local device.
★ 10,350 · C++Astrid - Secure OS on Rust
Astrid is a portable operating system with security capabilities, written in Rust for building composable software.
★ 10,291 · RustOpen-Source AI Agent
Cindy is an open-source AI agent that runs immediately without setup, letting you automate tasks using various LLMs.
★ 10,120 · TypeScriptMETAFLOW — ML MANAGEMENT
Metaflow simplifies building, managing, and deploying AI/ML systems on Python, allowing focus on data science.
★ 10,114 · PythonCocoindex: Incremental Engine for Agents
An incremental engine for agents with long-term horizon. If you like it, give it a star!
★ 9,785 · PythonAsync Coding Agent
An open asynchronous agent for automatic code writing and editing, built on LangChain.
★ 9,784 · PythonAI Code Without Limits
Endless free AI coding: connect any IDE to Claude/GPT/Gemini via 40+ providers with auto‑fallback and 40% token savings.
★ 9,759 · JavaScriptTOP LANGCHAIN PROJECTS
Discover a collection of tools and projects built on the powerful LangChain framework.
★ 9,597Unity MCP Bridge
Unity MCP connects Unity Editor with AI assistants via a local MCP client, enabling management of assets, scenes, scripts, and performing tasks.
★ 9,556 · C#OUMI EASY LLM TUNING
OUMI lets you quickly fine‑tune (SFT/RL), evaluate, and deploy Qwen, Gemma, and any open agentic LLM/VLM without extra complexity.
★ 9,433 · PythonORKAS: Multi-agent AI Assistant
Open-source desktop client for creating and managing a team of AI agents via chat. The LLM commander distributes tasks to sub-agents in parallel or sequentially.
★ 9,374 · TypeScriptSEATUNNEL DATA INTEGRATION
A multimodal distributed tool for large-scale data integration with high performance in Java.
★ 9,359 · JavaPRAISONAI: AI AGENTS FULLY OFFLINE
Open-source Python framework to run AI agents locally without internet. Ideal for regulated industries and anyone valuing data privacy. 9.3k stars on GitHub.
★ 9,336 · PythonXINFERENCE - ANY LLM ONE LINE
Replace GPT with any open model by changing just one line of code. Run LLM, multimodal, and speech models via a single production-ready API.
★ 9,318 · PythonAWESOME PROMPTS: LLM ENGINEERING
Collection of 9141★ curated prompts, frameworks and papers for LLMs and agents with engineering bias. Covers prompt engineering, context engineering, agents and red teami
★ 9,245 · PythonGENTLE AI: SMART AGENT FOR CODE
Gentle‑AI adds useful patterns to AI agents (Claude Code, Cursor, OpenCode), understanding plain language. It selects the path, stores context between sessions, checks wo
★ 9,198 · GoAI Agent Engineering Platform
An AI Agent Engineering Platform built on an open-source TypeScript AI agent framework.
★ 9,150 · TypeScriptMemOS: Memory for AI
Self-learning memory OS for LLMs and agents: persistent memory, hybrid search, and skill reuse with 35.24% token savings.
★ 9,147 · TypeScriptFAILPROOF AI: RELIABLE PROTECTION
failproofai intercepts infinite loops, dangerous actions, and secret leaks in real time, operating locally with zero latency.
★ 9,053 · TypeScriptAutonomous ML research in sleep
Markdown skills for LLM agents: cross-model reviews, idea search, and experiment automation.
★ 8,895 · PythonCAI: AI for Cybersecurity
Framework for securing AI agents. Over 8800 stars on GitHub.
★ 8,800 · PythonPlatform for SuperAgents
Corporate platform for creating intelligent agent workflows of the next generation with a commercial license.
★ 8,795 · JavaAutonomous Digital Agents
UFO³: Weaving the Digital Agent Galaxy
★ 8,763 · PythonUTOPIA: SELF-HOSTED KNOWLEDGE BASE
Utopia — self-hosted platform for RAG over documents on a knowledge graph that stores timestamps for each fact. Implemented in Rust + PostgreSQL, a single binary.
★ 8,712 · RustTYPECHAT: NATURAL LANGUAGE THROUGH TYPES
TypeChat simplifies creating natural language interfaces by describing them with TypeScript types. It provides reliable parsing and validation without extra code.
★ 8,693 · TypeScriptBENTOML PATH TO AI API
Serve models and AI applications in minutes: API, queues, multi‑model pipelines, and LLM services.
★ 8,663 · PythonOn-Device Android AI Agent
Mika is an on-device AI agent for Android that operates apps and browses the web to complete tasks autonomously.
★ 8,607 · KotlinGENIEX: LLMs on Devices
Run cutting-edge multimodal models on GPU, NPU, and CPU — from PC to mobile and IoT devices.
★ 8,530 · RustRAKAZO: Your AI Agent
Open-source alternative to Grok Bot: choose your model and sandbox, deploy an AI agent without being tied to closed services.
★ 8,499 · TypeScriptChatGPT Shortcut Hub
🚀💪Maximize your efficiency and productivity. The ultimate hub to manage, customize, and share prompts. (English/中文/Español/العربية). 让生产力加倍的 AI 快捷指令。更高效地管理提示词,在分享社区中发现适
★ 8,492 · TypeScriptDEEP SEARCHER AI AGENT
Deep‑searcher is an open‑source Python framework for deep research of private data. It offers an alternative to Reason and Search with agentic RAG, supporting Claude and
★ 8,395 · PythonMobile Chat Copilot
Reads QQ, X, and Feishu chats on your phone, suggests reply options, and lets you insert them with one tap.
★ 8,381 · KotlinPrompt engineering framework
The AI framework that adds engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible).
★ 8,300 · RustLMCache: LLM Acceleration
The fastest KV cache layer for large language models, boosting performance and reducing latency.
★ 8,292 · PythonBITSANDBYTES: LLM COMPRESSION
Library for k-bit quantization of large language models, enabling LLM execution on regular hardware via PyTorch.
★ 8,246 · PythonGPTCache: SEMANTIC CACHE FOR LLM
GPTCache provides semantic caching of requests to large language models, reducing token consumption and speeding up responses. Fully integrated with LangChain and llama_i
★ 8,224 · PythonSenseVoice: Voice Understanding Model
Multilingual model for analyzing and understanding speech in different languages with high accuracy.
★ 8,171 · PythonNEXA-SDK AI Everywhere Always
Run cutting‑edge LLMs and VLMs on GPU, NPU, and CPU — from PC to mobile and IoT devices. Support for models like GPT‑OSS, Granite‑4, Qwen‑3‑VL, and more.
★ 8,094 · RustADK-GO: AI Agent Framework
An open Go framework for building, evaluating, and deploying complex AI agents with flexibility and control.
★ 7,933 · GoAI engineering from scratch
Learn, build it, and deliver it to others.
★ 7,884 · PythonCHIC MCP FOR HOME ASSISTANT
Unofficial but cool MCP server for Home Assistant — 3500+ stars and pure Python.
★ 7,875 · PythonLMDeploy: Easy LLM Deployment
A toolkit for compressing, deploying, and serving LLMs. ⭐ 7873 | Python
★ 7,873 · PythonODS - YOUR AI SERVER
ODS turns any computer into a powerful AI server: LLM inference, chat, voice, agents, RAG, and image generation.
★ 7,832 · ShellSelf-Hosted A-Share Quant Workbench
A zero-maintenance, self-hosted platform for building, monitoring, and backtesting custom A-share trading strategies with LLM-assisted analysis.
★ 7,782 · PythonCODE TO PROMPT INSTANTLY
A Rust CLI tool that converts an entire codebase into a single LLM prompt, including a file tree, templates, and token count.
★ 7,765 · RustVISUAL GUIDE TO TRANSFORMERS
An interactive visualization that reveals how Transformer models work. Easy to understand even for beginners.
★ 7,761 · JavaScriptAI Infrastructure Book
Open‑source Chinese book on AI infrastructure, covering LLM inference and training system design with quantitative analysis, plus PDF, code tools, and experiments.
★ 7,748 · PythonPrompt Engineering in Practice
22 prompt engineering techniques using Jupyter Notebook, covering basics to advanced strategies for working with LLM.
★ 7,533 · Jupyter NotebookHERTZBEAT: AI MONITORING IN REAL TIME
Hertzbeat — an AI platform for real‑time monitoring and alerts, unifying metrics, logs, and tracing.
★ 7,470 · JavaGLM-5: FROM VIBE CODE TO AGENTIC ENGINEERING
GLM-5 helps transition from vibe coding to agentic engineering. It provides long‑term planning, code generation and self‑correcting agents. Enables building AI systems fo
★ 7,459COMBINE LLM MODELS EASILY
Mergekit offers tools to merge pretrained LLMs, combining weights, averages, and layers from different architectures like Llama. Output is a single model preserving the s
★ 7,452 · PythonNew projects on this topic in Telegram
Telegram →