R_REDDYX.XYZ

LLM: open-source projects on GitHub

2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

AI Agents 1319MCP 1602Openai 691Claude 978Claude Code 1595Agent 547RAG 533AI Agent 690Anthropic 452Developer Tools 620Agents 400Codex 849Self Hosted 361Agentic AI 378
e2b-dev/awesome-ai-sdks

AWESOME AI SDKS – COLLECTION

A database of SDKs, frameworks, and tools for building, debugging, and deploying autonomous AI agents. It simplifies selection and speeds up development.

★ 1,241
ASCIT31/Dark-Moon

DARK-MOON Autonomous AI Pentest

Autonomous AI engine for continuous pentesting of web, cloud, AD, and Kubernetes with real vulnerability exploitation.

★ 1,238 · Python
InternScience/GraphGen

GRAPHGEN: DATA SYNTHESIS FROM GRAPHS

GraphGen creates synthetic data for LLM fine-tuning from knowledge graphs. Integrated with LlamaFactory, it uses structured knowledge to generate quality samples. 1231 Gi

★ 1,234 · Python
Natively-AI-assistant/natively-cluely-ai-assistant

Native AI Assistant

Free open-source AI assistant for interviews and meetings, the best alternative to Cluely, Final Round AI, and Interview Coder. It provides real-time transcription, steal

★ 1,229 · TypeScript
trpc-group/trpc-agent-go

CREATE AI AGENTS IN GO

A powerful framework for building intelligent agent systems using LLM and external tools.

★ 1,229 · Go
zjunlp/LightMem

LIGHTMEM — Efficient LLM Memory

Lightweight generation with extended memory from the authors of ICLR 2026. 934 stars on GitHub.

★ 1,223 · Python
Zefan-Cai/R-KV

R-KV: Compress KV-Cache 1200+ Stars

NeurIPS 2025: smart KV-cache compression for reasoning models accounting for redundancy. Faster, less memory, same accuracy.

★ 1,223 · Python
garylab/MakeMoneyWithAI

MAKE MONEY WITH AI PROJECTS

A collection of open AI projects in Python that will help you quickly monetize ideas and automate earnings.

★ 1,221 · Python
openvinotoolkit/nncf

NNCFF - ACCELERATING MODEL INFERENCE

NNCFF is a neural network compression framework for accelerated inference in OpenVINO™. It reduces model size while preserving accuracy.

★ 1,221 · Python
DasterProkio/awesome-ai-companion

AWESOME AI COMPANION: PROJECTS COLLECTION

A list of open-source projects for building long-term AI companions: frontends, backends, memory, hardware, and integrations with the world.

★ 1,220 · Python
cvs-health/uqlm

UQLM: Detecting LLM Hallucinations

Python package for detecting language model hallucinations based on uncertainty quantification.

★ 1,217 · Python
ruc-datalab/EvoOntology

Self‑Evolving Data Ontology

Plugin that builds and continuously updates an ontology layer for data agents, enabling Claude Code/Codex to reason over evolving knowledge.

★ 1,213 · Python
bodaay/HuggingFaceModelDownloader

DOWNLOAD HUGGINGFACE MODELS EASILY

Go utility for downloading models and datasets from HuggingFace. Supports CLI call and work via API, caches files locally.

★ 1,213 · Go
superlinear-ai/raglite

RAGLITE - FAST RAG ON DUCKDB

Simple tool for building RAG pipelines with DuckDB or PostgreSQL in Python.

★ 1,212 · Python
xenodium/agent-shell

TITLE - AGENT SHELL IN EMACS

Agent Shell is a native Emacs buffer for interacting with LLM agents via the ACP protocol. It lets you chat with AI directly from the editor.

★ 1,210 · Emacs Lisp
currenjin/site-for-developers

SITE FOR DEVELOPERS AI

🌎💎 site-for-developers is a curated list of AI tools created specifically for developers. The project gathers the best tools for working with LLMs, RAG, multimodal mode

★ 1,210
FranciscoMoretti/chat-js

CHAT-JS: PRODUCTION-READY AI CHAT

Production-ready AI chat built with TypeScript. Easy to customize and integrate into any project.

★ 1,203 · TypeScript
rockbenben/subtitle-translator

SUBTITLES FOR ENTIRE SEASONS IN MINUTES

Translates whole season subtitles in one pass. Supports .srt/.ass/.vtt/.lrc, 120+ languages, 27 LLM providers. Timing untouched!

★ 1,201 · TypeScript
fmaclen/hollama

HOLLAMA: CHAT WITH LLM IN BROWSER

hollama — a minimal LLM chat that runs entirely in the browser. It connects to local models via Ollama and stores conversations in local storage.

★ 1,199 · TypeScript
bishwaghimire/ai-learning-roadmaps

AI LEARNING: ROADMAPS

Complete set of roadmaps and resources for AI, ML, DL, and Data Science — from beginner to expert.

★ 1,195
jmaczan/tiny-vllm

TINY VLLM: BUILD YOUR LLM

A mini version of vLLM in C++ and CUDA for fast inference of large language models. Enables building your own high-performance inference engine.

★ 1,194 · C++
ZHangZHengEric/Sage

SAGE: Multi-Agent System for Complex Tasks

Python framework for creating multi-agent systems capable of solving complex tasks together.

★ 1,193 · Python
rudrankriyam/Foundation-Models-Framework-Lab

FOUNDATION MODELS FRAMEWORK

A practical lab for building and testing applications using Apple Foundation Models.

★ 1,192 · Swift
madox2/vim-ai

VIM WITH AI ASSISTANT

Plugin vim-ai integrates OpenAI and ChatGPT models directly into Vim/Neovim. It offers code autocompletion, snippet generation, and code explanation via chat with AI. Sup

★ 1,191 · Python
google/adk-js

ADK‑JS AI Agent Toolkit

ADK‑JS is an open‑source TypeScript toolkit for building, evaluating, and deploying advanced AI agents with full control and flexibility.

★ 1,190 · TypeScript
patchy631/time-to-first-token

LLM Inference Optimization Roadmap

A 10‑week plan to study the service and accelerate large language models, covering vLLM, SGLang, quantization, and speculative decoding practices.

★ 1,179 · HTML
Edwardxlai/easyread

Read Papers in Comfortable Chinese

Local app for reading English PDFs in fluent Chinese, with side-by-side source, AI Q&A, and paper organization.

★ 1,177 · JavaScript
gufo-org/gufo

GUFO: INFERENCE ENGINE FOR STRIX HALO

gufo — inference engine for AMD Strix Halo in C++. Qwen Flash Next Q4_K_XL delivers 59.41 tok/s (1 user) and 157.22 tok/s (8 users). Qwen27B Q4_K_XL with DFlash2 gives 70

★ 1,176 · C++
chrishayuk/larql

RUST RUNTIME FOR LLM INFERENCE AND EDITING

larql — Rust runtime to run, serve, and edit models. VINDEX3 format makes models executable and inspectable. 1173⭐ on GitHub.

★ 1,175 · Rust
brainlid/langchain

LangChain on Elixir

Implementation of the LangChain framework in Elixir, enabling integration of large language models into projects.

★ 1,171 · Elixir
atlassian/atlassian-mcp-server

CONNECT ATLASSIAN TO AI

The official remote Atlassian MCP server securely connects Jira, Confluence, Bitbucket and other services to AI assistants via OAuth 2.1 or tokens.

★ 1,165 · JavaScript
berylliumsec/nebula

NEBULA — AI PENTEST ASSISTANT

Automates reconnaissance, note-taking, and vulnerability analysis in penetration tests.

★ 1,162 · Python
n8n-io/nod

PERSONAL AI AGENT

nod — open-source AI agent with its own virtual machine. It follows invoices, prepares calls and cancels trial periods on real websites, asking for confirmation before ac

★ 1,160 · TypeScript
mrwadams/stride-gpt

STRIDE GPT Threat Modeling AI

A strategic tool for automatically generating threat models using the STRIDE methodology with OpenAI's GPT.

★ 1,157 · Python
openonion/connectonion

CONNECTONION AGENT FRAMEWORK

The most advanced framework for collaborative work of AI agents in Python. Allows quickly creating and linking agents for complex tasks.

★ 1,155 · Python
ginlix-ai/LangAlpha

Claude Code for Finance

Claude Code, tailored for the finance sector. Enhances efficiency of analysis, modeling, and decision‑making.

★ 1,154 · Python
codelibs/fess

FESS: AI SEARCH FOR BUSINESS

Fess is an open source search server built on OpenSearch, indexing web, files, databases and clouds, supporting 20+ languages and semantic search with AI/RAG.

★ 1,151 · Java
zcbacxc/movie-narrator

AI MOVIE NARRATOR

Generates voiced video recaps of movies from a single text prompt. Combines an LLM for the script, FFmpeg for editing, and Python scripts for full automation. The result

★ 1,148 · Python
NovaSearch-Team/RAG-Retrieval

RAG-RETRIEVAL UNIFY SEARCH

The project unifies efficient fine-tuning of RAG search methods: embeddings, ColBERT, and reranker.

★ 1,138 · Python
Zleap-AI/SAG

SAG: WORKBENCH FOR DOCUMENT RAG

Ready-to-use workbench for document search based on SAG. TypeScript, 1136 stars!

★ 1,136 · TypeScript
dyoshikawa/rulesync

RULESYNC: UTILITY FOR AI AGENTS

CLI utility for managing AI agent rules while coding. 1135 stars on GitHub!

★ 1,135 · TypeScript
ombharatiya/ai-system-design-guide

GUIDE TO AI SYSTEMS

A practical guide to designing production-ready AI systems and evaluating their quality for engineers.

★ 1,132
vamplabAI/sgr-agent-core

SCHEMA-GUIDED REASONING AGENT

sgr-agent-core — a framework for building agent systems using Schema-Guided Reasoning in Python from the neuraldeep community.

★ 1,128 · Python
BlazeUp-AI/Observal

Observal - AI Agent Oversight

Observal is a platform for monitoring, evaluating, and debugging AI agents with human-in-the-loop feedback. It is essential for building reliable production pipelines.

★ 1,118 · Python
momozi1996/momo-code

MOMO CODE: AI AGENT FOR CODE

MOMO CODE — AI agent for programming in TypeScript with CLI. It evolves together with you, adapting to your coding style and suggesting improvements in real time.

★ 1,112 · TypeScript
wici-ai/inferssd

RUN MODELS LARGER THAN VRAM

inferssd runs MoE models exceeding RAM and VRAM by streaming experts from SSD. Built on llama.cpp with GGUF, CUDA and Apple Silicon support. 288 stars on GitHub.

★ 1,108 · C++
agentscope-ai/OpenJudge

OPENJUDGE - NEW AI EVALUATOR

Unified framework for evaluating the quality of AI agents. 671⭐ Python.

★ 1,105 · Python
EmbeddedLLM/JamAIBase

JAMAIBASE AI TABLE FOR TEAM

A table where cells are combined into AI pipelines, allowing experimentation with prompts and models in real time.

★ 1,103 · Python
six2dez/burp-ai-agent

Burp Suite AI Agent

Extension for Burp Suite that adds built‑in MCP tools, AI analysis, privacy controls, and passive and active scanning functions.

★ 1,102 · Kotlin
comarkdown/comark

COMARK: MARKDOWN PARSER WITH AI SUPPORT

Comark is an open-source Markdown parser and renderer that supports components, attributes and plugins. It streams AI output to React, Vue, Svelte, Angular, HTML and the

★ 1,101 · TypeScript
monarch-initiative/ontogpt

ONTOGPT: ONTOLOGY EXTRACTION

Ontogpt — an LLM‑tool for extracting ontologies from text, including the SPIRES method. It builds hierarchical taxonomies and generates OWL/RDF schemas ready for use in d

★ 1,099 · Jupyter Notebook
THU-BPM/MarkLLM

MARKLLM: WATERMARK FOR LLM

MarkLLM — open-source toolkit for watermarks of large language models. Allows embedding, checking and comparing different watermark schemes. Supports popular LLM and inte

★ 1,093 · Python
YuzeHao2023/Awesome-MCP-Servers

AWESOME MCP SERVERS: TOP LIST

A collection of the best Model Context Protocol servers for convenient work with AI agents.

★ 1,092
strands-agents/tools

POWERFUL TOOLS FOR AGENTS

A set of Python tools that extend the capabilities of AI agents.

★ 1,089 · Python
DemonDamon/AgenticX

AGENTICX — MULTI-AGENT PLATFORM

AGENTICX — a production‑ready multi‑agent framework for Python that includes an SDK, CLI, Studio server, and the Machi desktop app.

★ 1,085 · Python
jipraks/yt-short-clipper

TURN YOUTUBE INTO SHORTS IN MINUTES

Windows app turns long YouTube videos into vertical 9:16 clips. AI detects best moments, tracks face, and adds word-by-word captions.

★ 1,084 · TypeScript
Pan-Chera/Multi-Agent-CAD

MULTI-AGENT CAD 3D GENERATOR

A framework for generating CAD models from natural‑language text using multi‑agent collaboration and bounded test computation.

★ 1,081 · Python
tryAGI/LangChain

LangChain on C#: AI Agent

C# implementation of LangChain, as close as possible to the original, open to new entities.

★ 1,080 · C#
philippgille/chromem-go

CHROMEM-GO: VECTOR DB WITH ZERO DEPENDENCIES

Embeddable vector DB in pure Go. Chroma-like API, zero external deps, runs in-memory with optional persistence.

★ 1,078 · Go
Onelevenvy/flock

FLOCK: MULTI-AGENT PLATFORM ON RUST

Desktop framework for multi-agent systems built with Rust, Tauri, and React, with LangGraph support.

★ 1,077 · Rust

New projects on this topic in Telegram

Telegram →
LLM — page 14 | REDDYX AI