Llms: open-source projects on GitHub
136 repositories on Llms, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
BEST LLM SKILLS COLLECTION
Curated list of skills and tools for AI agents working with Claude Code, Codex, and Gemini CLI.
★ 1,865 · PythonCONTEXTGEM: LLM DOCUMENT EXTRACTION
ContextGem lets you extract structured data from any document using LLMs without complex code.
★ 1,844 · PythonADK-JAVA - CODE FRAMEWORK FOR AI
Open-source Java toolkit for creating, evaluating, and deploying AI agents with full control over code.
★ 1,769 · JavaPRACTICAL AI ON GITHUB
Collection of 1670★ practical AI projects: from OCR and RAG to agents — all in Python and ready to use.
★ 1,670 · PythonPaperBanana: Scientific Visualization Generation
An open-source implementation and extension of Google Research PaperBanana for automating the creation of academic figures, diagrams, and scientific visualizations.
★ 1,648 · PythonGRAPHICAL RAG AGENT FOR COMPLEX QUESTIONS
Controllable‑RAG-Agent is an advanced Retrieval‑Augmented Generation system for answering complex questions. It uses a graph‑based search algorithm and integrates with La
★ 1,631 · Jupyter NotebookLLM EVALUATION SURVEY
Official repository page for the survey paper on evaluation of large language models.
★ 1,616AGENTLY: SIMPLIFYING GEN-AI DEVELOPMENT
Agently — a Python framework for rapid creation of GenAI applications: simple code, event-driven flow, and easy model swapping.
★ 1,584 · PythonGENERATIVE_AI_WITH_LANGCHAIN - BUILD PRODUCTION LLM
Notebooks for creating production-ready LLM applications and agents using LangChain and LangGraph. Practical examples from the generative AI book.
★ 1,459 · Jupyter NotebookPARITOK-4B: REDUCING TOKEN USAGE 90%
Lossless code compression gateway cuts AI agents' token usage by 25% per turn and up to 90%+ in long sessions. Open 4B model, ready to use with Claude Code, Cursor, Codex
★ 1,446 · PythonEvolving Skills for AI
Collective skill evolution through an agent evolver — let skills develop alongside your AI.
★ 1,395 · PythonLANGCHAIN ON RUST: LLM APPS MADE SIMPLE
LangChain for Rust — official port of the popular framework. Write LLM apps in Rust with the same simplicity as Python.
★ 1,362 · RustSKYBRIDGE — MCP & CHATGPT FRAMEWORK
A full-featured TypeScript framework for building MCP and ChatGPT apps. Type‑safe, React‑based, runs on any platform.
★ 1,335 · TypeScriptMULTI-AGENT LLMS SURVEY 2024
A comprehensive review of LLM-based multi-agent systems — progress, challenges, and prospects. The paper has been accepted at IJCAI 2024.
★ 1,335LLMGATEWAY: UNIFIED API FOR ALL LLM
Manage requests to different LLM providers through a single unified interface. 1.2K ⭐ on GitHub.
★ 1,252 · TypeScriptLLM Architecture Gallery
A collection of diagrams and visualizations of key AI model architectures for a deep understanding of structures.
★ 1,244PROXIMA: UNITE AI WITH TOOLS
Proxima — an MCP server that connects ChatGPT, Claude, Gemini and Perplexity to your development tools without direct API calls. It supports JavaScript and has already ga
★ 1,210 · JavaScriptADK‑JS AI Agent Toolkit
ADK‑JS is an open‑source TypeScript toolkit for building, evaluating, and deploying advanced AI agents with full control and flexibility.
★ 1,190 · TypeScriptAGENTS: CREATE AI AGENTS NO CODE
Create AI agents in a visual builder or via the TypeScript SDK with full two-way synchronization.
★ 1,169 · TypeScriptCHROMEM-GO: VECTOR DB WITH ZERO DEPENDENCIES
Embeddable vector DB in pure Go. Chroma-like API, zero external deps, runs in-memory with optional persistence.
★ 1,078 · GoSelf-improving AI framework
Recursive framework for improving agents and their future versions in solving any tasks
★ 1,015 · PythonOpenInference - Real-Time AI Tracing
OpenInference adds OpenTelemetry instrumentation for observing AI model operations, simplifying debugging and monitoring of LLM agents.
★ 1,015 · PythonMCPDOC - IDE FOR LLM
Integrates llms-txt into popular IDEs, accelerating work with language models.
★ 998 · PythonVECTORDB-RECIPES: RAG AND AGENTS BY EXAMPLE
Collection of notebooks with RAG, multimodal AI and agents examples. Covers embeddings, fine-tuning and vector search. 986 stars on GitHub.
★ 989 · Jupyter NotebookMCP PLUGIN FOR K8S
Published in CNCF Landscape: MCP server for Kubernetes management.
★ 972 · PythonSPARK-X2.6: AGENTS ON DEVICE
Open Spark-x2.5 model series focused on agentic capabilities. Runs locally on device without cloud. 814 stars on GitHub.
★ 911AWESOME AGENTIC DEEP RESEARCH
A collection of the best resources on agentic deep research from ACL 2026 KnowFM. Helps find cutting-edge methods and tools.
★ 876Open AI Workstation
Open‑WebUI Tools — a set of 15+ tools and filters that turn Open WebUI into a powerful AI workstation.
★ 837 · PythonMOSS-VL: 11B MODEL FOR VIDEO
The open-weight MOSS-VL series of 11-billion-parameter models is designed for understanding long-form and streaming video in real time. It supports multimodal input and e
★ 833 · PythonDEEP AGENTS IN 5 MIN
Build Claude Code‑level agents with Pydantic AI: tool‑calling, sandbox, multi‑agent commands, and unlimited context.
★ 825 · PythonMASCOT: Multi-Agent Assistant
MASCOT is a multi-agent socially collaborative assistant presented at EMNLP 2026. The project is implemented in Python and has already garnered 518★.
★ 804 · PythonSURROGATE — POWERFUL FINE-TUNING IN C++
Training and fine-tuning models at the speed of light. 796 stars on GitHub.
★ 796 · C++GIVE MEMORY TO AI AGENTS
Give your AI agents persistent memory.
★ 748 · PythonMCP-NEST: BUILD MODELS
MCP-Nest is a NestJS module for quickly creating Model Context Protocol servers that expose AI tools and prompts.
★ 733 · TypeScriptSQZ: COMPRESSION FOR AI AGENTS
SQZ compresses tool output before it reaches the LLM, replacing repeated fragments with short 13‑token references. Works with Claude Code, Cursor, Codex, Kiro, Zed and an
★ 677 · RustLLM News in Social Science
A collection of outstanding works where language models are applied in social sciences. Perfect for researchers and students.
★ 653KANI: MICROFRAMEWORK FOR LLM TOOLS
Kani — a Python microframework for building tool‑calling agents with support for GPT‑4, Llama and other LLMs. It lets you quickly connect arbitrary functions and tools vi
★ 613 · PythonGRAPHRAG IN OPEN WEBUI
The project integrates Microsoft GraphRAG into Open WebUI. Combines local, global, and web search for advanced Q&A systems. Simplifies graph-based retrieval integration i
★ 604 · PythonMMMU: Multimodal Benchmark
Code evaluation for MMMU benchmark measuring multidisciplinary multimodal understanding and reasoning for expert AGI.
★ 601 · PythonLINEARRAG - LINEAR KNOWLEDGE SEARCH
LinearRAG is a linear graph RAG for large corpora (ICLR 2026). It accelerates retrieval and answer generation with minimal resources.
★ 571 · PythonNOTES ON LLMS FOR PRODUCTION
Repository with Jupyter notebooks from the book «Building LLMs for Production» by Towards AI. Examples of agents, RAG pipelines, integrations with LangChain and LlamaInde
★ 567 · Jupyter NotebookSECOND BRAIN - YOUR DIGITAL OS
An agent framework that automates tasks using LLM and file intelligence — 552 stars, Python. Excellent DevTools for cross‑platform automation!
★ 552 · PythonSIMPLEMIND: LIGHTWEIGHT AI API CLIENT
Python client for Anthropic, Gemini, and other LLMs. Replaces LangChain and LangGraph for common tasks — no extra abstractions or complexity.
★ 541 · PythonNEURO-SAN AI STUDIO
Neuro-san studio – a playful environment for rapid prototyping and testing of neural networks in Python. Suitable for experiments with LLMs and generative models.
★ 523 · PythonOPEN-PROMPT-INJECTION
Open-Prompt-Injection — benchmark for evaluating attack and defense against prompt injections in LLMs. Contains datasets,test scripts,defense metrics. Implemented in Pyth
★ 514 · PythonAGENTIC AI: BUILDING AGENTS
Practical materials for designing and building Gen‑AI agents in Python: architecture, tools, and ready examples.
★ 504 · PythonAgency: Minimal Framework for Agents
Fast and minimalistic framework in Python for building agent systems. 486 stars on GitHub.
★ 491 · PythonALWAYS-ACCOMPANY - AI PARTNER FOR CODE
The always-accompany project creates an AI agent with shared memory and context for chat, code, and collaboration — like in science fiction.
★ 460 · JavaScriptLYNKR SIMPLIFYING CODE WORK
Lynkr is a CLI utility that acts as an HTTP proxy for fast interaction with Claude Code and streamlines development workflows.
★ 445 · JavaScriptOLYMPUS UNIFIES CV TASKS
The official Olympus code — a universal task router for CV, presented at CVPR 2025. Routes data to the best models.
★ 427 · PythonLLM Inference Engineering
Step-by-step training on inference engineering techniques for large language models: KV cache, PagedAttention, batching, and frameworks vLLM, SGLang.
★ 412 · MarkdownSMART HOME WITH AI AGENT
Integration of a generative agent for Home Assistant based on LangChain and LangGraph. Home automation with AI.
★ 378 · PythonCHONK TEXT WITH CHONKIE JS
Fast and lightweight TS library for text chunking. Ideal for LLM, RAG, and working with large documents.
★ 370 · TypeScriptMONOCLE - GenAI App Tracing
Framework for tracing GenAI application code in Python. Easily track the execution of your AI applications.
★ 346 · PythonMIKROTIK MCP SERVER ON PYTHON
MikroTik‑MCP — Python Model Context Protocol server for AI agents. It allows you to manage the MikroTik devices via the API: read the configuration, execute commands, an
★ 337 · PythonHYPER-RAG: FIGHTING HALLUCINATIONS
A new approach to RAG using hypergraphs for accurate LLM answers without hallucinations.
★ 331 · PythonHUD-Python RL Evaluation
An OSS environment for RL with ready‑to‑use agent evaluation tools. Run, configure, and get results.
★ 329 · PythonPICOLLM - OFFLINE LLM ON DEVICE
picollm enables running LLM on-device through extreme k‑bit quantization, delivering fast and private inference without the cloud.
★ 320 · PythonDEEP RESEARCH TOOL FOR LOCAL KB
DeepDoc — a Python tool for deep research on a local knowledge base. It indexes files, builds semantic links and answers complex questions using agentic AI.
★ 317 · PythonNOVA3D — 3D GENERATION
Editable 3D generation from text or images. Client for nova3d.xyz. Dart, 316 stars.
★ 316 · DartNew projects on this topic in Telegram
Telegram →