LLM: open-source projects on GitHub
2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
OPENSCIENCE AI RESEARCH
Open-source AI Sonntag for scientific research in TypeScript. Machine learning will accelerate experiments.
★ 4,386 · TypeScriptHARNESSROUTER UNIFIED API FOR AGENTS
HarnessRouter Community Edition — implementation under Apache‑2.0 of a unified API for agents. Runs Codex, Claude Code, Hermes, PI, DSH through a single API with sessions
★ 4,362 · PythonClaude Code: All Levels
Complete guide to Claude Code from basics to advanced scenarios — templates, agent workflows, tests, and cheat sheet for maximum productivity.
★ 4,357 · TypeScriptOPTILLM — SPEEDING LLM INFERENCE
optillm — a proxy accelerator for LLMs that reduces latency and saves resources during inference.
★ 4,343 · PythonDEEPFLOW: eBPF TRACING AND PROFILING
Deepflow is a Go project for distributed tracing and profiling using eBPF. It lets you quickly find bottlenecks in microservices.
★ 4,325 · GoAGENT MEMORY: MARKDOWN IN CLOUD
Long‑term memory for AI agents: Markdown — source of truth, local ranked retrieval and a separate sleep layer. Claude Code and Codex share one store, no API key needed.
★ 4,317 · PythonGPTME: YOUR TERMINAL AGENT
An autonomous agent in the terminal using Python, writes code, manages the command line and browses the web. Create your persistent AI assistants in minutes!
★ 4,314 · PythonMCP SERVER FOR EXCEL
excel-mcp-server — a Model Context Protocol server for Excel manipulation. It lets LLM agents read, edit, and create spreadsheets via a unified API. Written in Python, it
★ 4,303 · PythonOPEN INTELLIGENT UI FRAMEWORK
OpenIntelligentUI — a generative framework for building interactive UIs from text prompt. It supports agent‑native workflows, real‑time AI‑agent visualization, and TypeSc
★ 4,237 · TypeScriptBRAG-LANGCHAIN: YOUR RAG
A complete set of tools and examples for building RAG applications in Jupyter Notebook. A quick start and deep understanding.
★ 4,202 · Jupyter NotebookKoog — AI Framework for JVM
A powerful Kotlin framework for building reliable and resilient AI agents ready for enterprise use. Supports backend, Android, iOS and browsers.
★ 4,197 · KotlinTRAIN LLM FROM SCRATCH
A simple path from loading data to text generation with your own LLM.
★ 4,188 · Jupyter NotebookIntelligent System Router
An intelligent router for managing mixed models in the cloud, data centers, and at the edge.
★ 4,182 · GoSPARK-NLP - REVOLUTION IN NLP
Spark NLP provides state-of-the-art NLP models and ready-to-use pipelines for scalable text processing in Scala.
★ 4,163 · ScalaBuild AI agents locally
Build AI agents from scratch on a local LLM — no black boxes, with understanding of function calling, memory, and ReAct.
★ 4,162 · JavaScriptGIGATOKEN — GB/s Tokenization
gigatoken — fast tokenization of language models in Rust, achieving gigabyte-per-second speeds.
★ 4,155 · RustAdalFlow - Boost LLM Efficiency
A library for building and auto-optimizing LLM-based applications in Python. Simplifies working with prompts and model configuration.
★ 4,153 · PythonOpenClaw Chinese Use Cases
More than 50 OpenClaw scenarios: automation, content, DevOps, AI assistant and knowledge. Adapted for Chinese and international experience.
★ 4,146Local Memory for LLMs
Persistent memory storage for applications with LLMs: Claude Desktop, GitHub Copilot, Codex and others. Runs locally on your device.
★ 4,116 · TypeScriptLightLLM - Fast LLM Inference
A lightweight and fast framework for inference and serving of large language models in Python. Simple scaling and high performance.
★ 4,092 · PythonONE DNN: ACCELERATING AI ON CPU
oneDNN provides high-performance AI kernel implementations for x64, AArch64, RISC‑V, and Intel GPUs. It accelerates PyTorch, TensorFlow, OpenVINO, and ONNX Runtime using
★ 4,092 · C++CISO Assistant - Global GRC Platform
CISO Assistant unifies risk management, AppSec, compliance, and audit in a single platform, supporting 150+ global frameworks.
★ 4,088 · PythonCSGHUB — PLATFORM FOR LLM
CSGHub — a new open‑source platform from OpenCSG for managing LLMs, datasets and agents. Supports on‑premise and SaaS deployments, compatible with the Python SDK of Huggi
★ 4,082 · VueLemonade SDK
Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!
★ 4,059 · C++WSLMANAGER: GUI FOR WSL AND VM
WSLManager — graphical interface for managing WSL, Linux and macOS VM. Allows installing, backing up, moving and configuring distros without CLI, and the AI assistant wit
★ 4,058 · DartNIKSTLA - TIME AI FORECAST
TimeGPT‑1 is a pretrained time‑series model trained on 100 billion points, delivering accurate forecasts and anomaly detection for retail, energy, finance, and IoT.
★ 4,050 · Jupyter NotebookGENERATIVE AI MICROSERVICE WORKFLOW
A collection of generative AI examples optimized for accelerated infrastructure and microservices architecture. Ready-to-use Jupyter notebooks for a quick start.
★ 4,037 · Jupyter NotebookLANGRID - Multi-agent AI for Code
A simple framework for building LLM-based agents with memory and tool support.
★ 4,029 · PythonNVIDIA AGENT SKILLS
A set of skills for coding agents that enables running physical AI, robotics, simulations, CUDA, and RAG in Claude Code and Codex.
★ 4,002 · PythonSWANLAB: TRACKING AND VISUALIZATION
SwanLab is an open-source tool for tracking and visualizing AI model training, compatible with PyTorch, Transformers, and other frameworks.
★ 3,981 · PythonRUBY LLM: UNIFIED API
Ruby gem for working with OpenAI, Anthropic, Gemini and other LLMs via a unified API. Supports chat, vision, audio, embeddings, and Rails integration.
★ 3,976 · RubyCASCADEFLOW SPEEDS UP AI AGENTS
Cascading runtime for AI agents that optimizes cost, latency, quality, and policy inside the agent loop.
★ 3,926 · PythonResources for game development
Collection of game engines, tutorials, assets, and tools. Over 3800 stars on GitHub.
★ 3,897MEMORY FOR AI AGENTS
SimpleMem — efficient long-term memory for LLM agents with support for text and multimodal data.
★ 3,878 · PythonEagle: Next-Gen Visual AI
Eagle — cutting‑edge multimodal models in VLM format, developed using a Data‑Centric strategy. Over 2700 GitHub stars and actively evolving.
★ 3,857 · PythonClawith AI Agent Platform
Clawith provides tools for creating, training, and deploying autonomous AI agents that can handle complex business tasks. The platform is built on Python and easily integ
★ 3,852 · PythonLAZYLLM - THE LAZIEST WAY
LazyLLM lets you quickly create multi-agent LLM applications with minimal code and maximum simplicity.
★ 3,833 · PythonClaude Code Internals
Deep dive into Claude Code architecture: agent loop, context engineering, tool system, and key operational mechanisms.
★ 3,830LLAMASHARP - LOCAL LLM ON C#
A C#/.NET library for efficiently running LLaMA and LLaVA LLM models on a local device.
★ 3,826 · C#ONE KEY — 70+ AI MODELS
Open-source bot: GPT, Claude, Gemini, DeepSeek and 70+ models via one Modelflare key. In app, WeChat, Feishu — remembers context, runs commands, controls PC. Pay per use.
★ 3,822 · TypeScriptVIBE‑SKILLS: ENHANCE AGENT
Vibe‑Skills is an AI‑skill package with context management for instant upgrade of any agent.
★ 3,821 · PythonCLARAVERSE — PRIVATE AI ECOSYSTEM
Claraverse is an open-source ecosystem for replacing ChatGPT, Claude, and N8N with your own LLM. Desktop, iOS, and Android. 3819 ⭐
★ 3,819 · GoSEPIA: CLEANING TEXT OF AI STYLE
sepia removes the AI style from texts Claude Code, Codex, Grok Build and Antigravity, restoring a narrative structure of fictional works. Applies the venue‑matched format
★ 3,817 · ShellWorkBuddy Practical Guide
Open guide to mastering WorkBuddy through real workflows: tutorials, integration examples, automation, and multi-agent system practices.
★ 3,815 · TypeScriptOpen AI Gateway
A universal open-source gateway for working with 100+ LLMs via any SDK, featuring failover, load balancing, cost control, and full tracing.
★ 3,811 · GoXIAOJU SURVEY FORM BUILDER
XIAOJU SURVEY is an enterprise form builder and analytics platform built with TypeScript. It lets you create surveys, tests, polls and quizzes, and collect and analyze re
★ 3,803 · TypeScriptAI SYSTEM SECURITY
A platform for testing the security of AI ecosystems: scanning infrastructure, MCP, agents, and evaluating jailbreak attacks.
★ 3,790 · PythonOpenClaw in Russian
Russian localization of OpenClaw — a personal AI assistant supporting Claude/ChatGPT, messengers, and automatic synchronization.
★ 3,780 · JavaScriptAI‑ENGINEER HQ: SCIENCE CORE
The project contains Jupyter notebooks with methods for training models, RAG pipelines on LangChain and data structure algorithms for AI agents. It allows quickly creatin
★ 3,780 · Jupyter NotebookDocetl: Agent LLM ETL
Docetl is a system for agentic LLM data processing and ETL, enabling automation of complex pipelines using AI agents.
★ 3,765 · PythonOpenOutreach - AI Lead Search
OpenOutreach automates finding and connecting with potential clients on LinkedIn using AI.
★ 3,720 · PythonLLM WORKFLOW ENGINE – CONVENIENT CLIENT
PowerCLI for LLM – create, run and manage complex workflows with one click.
★ 3,715 · PythonLLM-WIKI-AGENT: YOUR KNOWLEDGE BASE BUILDS ITSELF
Drop the sources — the agent will read, extract knowledge, and build a linked wiki. Works with Claude, Codex, Gemini; no API key needed.
★ 3,704 · PythonToken Monitor: Real-Time Tracking
Widget for tracking tokens, costs, and limits of AI tools in real time with cross-device synchronization.
★ 3,701 · JavaScriptACONTEXT: MEMORY LAYER FOR AI AGENTS
Acontext creates a memory layer for AI agents, enabling skill persistence and reuse across sessions. The platform provides contextual storage, versioning, and agent execu
★ 3,695 · JavaScriptFASTDEPLOY — FAST LLM DEPLOYMENT
High-performance toolkit for inference and deployment of LLMs and VLMs based on PaddlePaddle. 3691 ⭐
★ 3,691 · PythonATOMIC AGENT: LOCAL AI
The local AI agent atomic-agent runs entirely on your device, supports long context and precise tool invocation.
★ 3,682 · TypeScriptCognitive Memory Engine
A bioinspired cognitive engine based on a graph RAG architecture—a new paradigm for intelligent knowledge storage and retrieval in Python.
★ 3,650 · PythonTRACECAT — AI Security Platform
An open‑source platform for security automation that enables teams and AI agents to respond quickly to threats.
★ 3,623 · PythonOpen AI Catalog
A list of the best truly open-source AI projects, models, tools, and infrastructure. Helps developers find high-quality open-source resources.
★ 3,559 · PythonNew projects on this topic in Telegram
Telegram →