R_REDDYX.XYZ

LLM: open-source projects on GitHub

2094 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

AI Agents 1319MCP 1602Openai 691Claude 978Claude Code 1595Agent 547RAG 533AI Agent 690Anthropic 452Developer Tools 620Agents 400Codex 849Self Hosted 361Agentic AI 378
aws-samples/generative-ai-use-cases

GENERATIVE AI FOR BUSINESS

The project demonstrates practical scenarios of applying generative AI in corporate processes with an emphasis on security and scalability.

★ 1,403 · TypeScript
alibaba/rtp-llm

RTP-LLM ENHANCED LLM INFERENCE

High-performance LLM inference engine from Alibaba, written in CUDA, enables fast model operation across diverse applications.

★ 1,400 · Cuda
aws-samples/aws-genai-llm-chatbot

aws-genai-llm-chatbot - POWERFUL CHATBOT ON AWS

Modular solution for a chatbot with multiple LLMs and RAG on AWS CDK. Integrate Anthropic, OpenAI, HuggingFace models.

★ 1,399 · TypeScript
explosion/spacy-llm

LLM IN SPACY PIPELINE PAINLESSLY

spacy-llm connects GPT, Claude, Cohere and open models to spaCy pipeline. Configure via config, get structured Doc with entities and relations. No wrapper code — pure NLP

★ 1,399 · Python
AMAP-ML/SkillClaw

Evolving Skills for AI

Collective skill evolution through an agent evolver — let skills develop alongside your AI.

★ 1,395 · Python
Zefan-Cai/KVCache-Factory

KVCache-Factory: Cache Compression for LLM

Unified KV-cache compression methods for autoregressive models. Memory savings and faster inference in one package.

★ 1,394 · Python
ngxson/wllama

WLLAMA: LLM in Browser, No Server

WebAssembly binding for llama.cpp allows running large language models directly in the browser.

★ 1,392 · TypeScript
PrunaAI/pruna

PRUNA - ACCELERATING MODELS

Pruna — a Python framework for model optimization that speeds up inference and reduces resource usage without losing accuracy.

★ 1,391 · Python
giuseppe99barchetta/SuggestArr

SUGGESTARR: AUTO PICK

Automatically requests movie and series recommendations for Overseerr/Jellyseerr based on viewing history from Plex, Emby, or Jellyfin.

★ 1,391 · Python
agentes-chat/agentes-chat

OPENSOURCE SLACK WITH AI AGENTS

Self-hosted Slack alternative. Teams and AI agents collaborate in channels and DMs. Agents on Claude, GPT, Gemini, Grok with MCP, browser, memory, approvals. Docker Compo

★ 1,391 · TypeScript
CopilotKit/OpenGenerativeUI

OPENGENERATIVE UI - EASY GENERATIVE INTERFACES

OpenGenerativeUI is an open-source TypeScript framework for quickly creating generative interfaces with AI support.

★ 1,384 · TypeScript
NPC-Worldwide/npcpy

NPCPY: LIBRARY FOR NLP AND LLM

The npcpy library simplifies research in NLP, multimodal LLMs, and agent creation by combining ML, knowledge graphs, and more.

★ 1,379 · Python
jxzhangjhu/Awesome-LLM-RAG

AWESOME-LLM-RAG: BEST RAG SOLUTIONS

A collection of the best resources and libraries for building Retrieval Augmented Generation in large language models.

★ 1,374
ThousandBirdsInc/chidori

CHIDORI: Reliable Agent Framework

The Rust framework makes each agent run durable, reproducible, and resumable by default.

★ 1,373 · Rust
hanzohanzhe/Grandet

AI Model Price Finder

Grandet lets AI agents discover the cheapest API for any model and connect via its Skill and anonymous MCP server, using price data from over 1,800 providers.

★ 1,372 · JavaScript
0xsline/awesome-deepseek-harness

awesome-deepseek-harness - SPEEDING WORK WITH DEEPSEEK

Ecosystem of plugins and tools for DeepSeek Harness: ready-made solutions from dsh-external/hub and the public topic dsh-plugin.

★ 1,370 · Python
maziyarpanahi/openmed

OpenMed AI for Healthcare

OpenMed is an open-source Python project using AI for medical data analysis and clinical decision support.

★ 1,365 · Python
study8677/repobrain

REPOBRAIN — BRAIN FOR YOUR CODE

RepoBrain turns your repository into a smart assistant: ask questions about the code in plain language. It supports Claude Code, Cursor, Codex, Windsurf, and more.

★ 1,362 · Python
Abraxas-365/langchain-rust

LANGCHAIN ON RUST: LLM APPS MADE SIMPLE

LangChain for Rust — official port of the popular framework. Write LLM apps in Rust with the same simplicity as Python.

★ 1,362 · Rust
ggml-org/llama.vscode

LLM CODE COMPLETION

VS Code extension for LLM-powered code and text autocompletion. 1359 stars on GitHub.

★ 1,359 · TypeScript
Open-Less/openless

Voice input with AI processing

Hold the key, speak, release — AI-enhanced text will appear next to the cursor in any application.

★ 1,356 · HTML
peonist-ai/halogen-flash-server

FAST LAUNCH QWEN3.8 ON AMD

The project provides scripts for instant deployment of Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151) GPU via HIP. All dependencies are built automatically, and inference

★ 1,349 · Shell
lean-dojo/LeanCopilot

LEARNCOPILOT: AI Proof Assistant

The project uses large language models as a copilot to assist in proving theorems in Lean.

★ 1,345 · C++
taichengguo/LLM_MultiAgents_Survey_Papers

MULTI-AGENT LLMS SURVEY 2024

A comprehensive review of LLM-based multi-agent systems — progress, challenges, and prospects. The paper has been accepted at IJCAI 2024.

★ 1,335
oritera/Cairn

Cairn AI State Search

Cairn is an AI-powered state‑space search engine, initially tested for autonomous pentesting. Written in Python, it has already garnered over 1.3k stars.

★ 1,333 · Python
rynfar/meridian

Meridian Proxy for Claude Max

Meridian is a custom proxy that lets you use your Claude Max subscription with OpenCode, Pi, Droid, Aider, Crush, Cline, and other tools. 1328 stars on GitHub.

★ 1,328 · TypeScript
ipa-lab/hackingBuddyGPT

HACKINGBUDDY GPT HELPER

The project helps ethical hackers use LLMs in 50 lines of code or less. Rapid AI integration into pentest workflows.

★ 1,328 · Python
aws-samples/bedrock-chat

BEDROCK-CHAT: AWS CHATBOT IN TYPESCRIPT

AWS-native chatbot on Bedrock, written in TypeScript, for quickly creating AI assistants.

★ 1,325 · TypeScript
kantord/SeaGOAT

SEAGOAT: LOCAL SEMANTIC SEARCH

SeaGOAT — a local semantic code search engine that works without cloud dependency. It uses embeddings and tree‑sitter to index the repository and search by meaning, not e

★ 1,322 · Python
sierra-research/tau2-bench

TAU2-Bench: Benchmark for AI Agents

τ-Bench tests AI agents in real‑world tasks. The Python project already has 1.3k stars.

★ 1,319 · Python
caliber-ai-org/ai-setup

AI-Setup: One-Key Sync

Sync AI-agent settings for Claude Code, Cursor, and Codex with a single command. Supports skills, MCP files, and configs.

★ 1,315 · TypeScript
tmgthb/Autonomous-Agents

AUTONOMOUS LLM AGENTS

A collection of research papers on LLM-based autonomous agents. Updated daily — 1311 stars on GitHub.

★ 1,311
SaladDay/pi-from-scratch

Mini‑pi on TypeScript

An ultra‑compact implementation of π in TypeScript (~600 lines) that lets you build your own pi‑agent from scratch for any task.

★ 1,308 · TypeScript
dabit3/react-native-ai

REACT NATIVE AI - MOBILE APPS

A full-featured TypeScript framework for building cross-platform mobile apps with AI.

★ 1,305 · TypeScript
GradientHQ/parallax

PARALLAX: BUILD AI CLUSTER

Parallax lets you quickly deploy a distributed inference service on any infrastructure.

★ 1,301 · Python
TIGER-AI-Lab/ClawBench

ClawBench - Benchmark for AI Agents

Open-source benchmark for evaluating browser AI agents on everyday tasks. Already earned ⭐ 385!

★ 1,301 · Python
Jwuthri/Tracely-ai

TRACELY-AI - AUTOMATED AGENT TESTING

Tracely-ai automatically turns AI agent failures into regression tests that block PRs and reproduces them in CI for free.

★ 1,299 · Python
atomicstrata/llm-wiki-compiler

LLM AUTOMATICALLY COLLECTS WIKI

Knowledge compiler: raw sources → interlinked wiki. Inspired by Karpathy's LLM Wiki pattern; TypeScript, ⭐1292.

★ 1,292 · TypeScript
kubeai-project/kubeai

KUBEAI – Integral Inference Operator

AI Inference Operator for Kubernetes: the simplest way to deploy ML models in production. Supports VLM, LLM, embeddings, and STT.

★ 1,291 · Go
NVIDIA-NeMo/labs-molt

LABS-MOLT: AGENTIC RL FRAMEWORK FOR RESEARCH

Scalable framework for agentic RL built on HuggingFace and supporting context‑ and expert‑parallelism with FSDP. Contains 9 000 lines of Python and already has 1 164 star

★ 1,290 · Python
vstorm-co/full-stack-ai-agent-template

Full-Stack AI Template

Fullstack app generator for FastAPI and Next.js featuring AI agents, RAG, streaming, authentication, and 20+ ready integrations.

★ 1,289 · Python
sgl-project/SpecForge

QUICKLY TRAIN SPECULATIVE DECODER

SpecForge simplifies training speculative decoding models and exporting them to SGLang for high-performance serving.

★ 1,285 · Python
JMAN730/opendroid

OPEN AUTONOMOUS ANDROID AGENT

opendroid — production-ready autonomous agent for Android. Plans tasks itself and controls screen via Accessibility API. Works with local and remote LLMs.

★ 1,285 · Kotlin
designcomputer/mysql_mcp_server

MYSQL_MCP_SERVER - SECURE ACCESS TO DATABASE

The MCP server provides secure interaction with MySQL via a standard protocol, simplifying integration of AI agents with databases.

★ 1,283 · Python
dagoSte/squadra

COORDINATION OF CLAUDE CODEX CURSOR

squadra synchronously manages windows of Claude, Codex and Cursor: tasks, prechecks, parallel tests. Built-in skills recall lessons, simplify code and forecast work.

★ 1,279 · Python
Jenqyang/Awesome-AI-Agents

Awesome AI Agents — LLM-based Collection

A large collection of LLM-based autonomous agents 🤖️, ranging from simple to advanced scenarios.

★ 1,275
mrwadams/attackgen

ATTACKGEN: AI INCIDENT RESPONSE

Generates realistic cyberattack scenarios using LLM and MITRE ATT&CK, tailored to your organization and selected threat groups.

★ 1,275 · Python
yohey-w/multi-agent-shogun

Shogun: Multi-Agent System

A system of parallel AI tasks for Claude Code featuring a shogun → karō → ashigaru hierarchy via tmux.

★ 1,273 · Shell
Rizzo-AI-Academy/rizzo-pii

RIZZO PII: Document Anonymization

A local Python utility that removes personal data from files before sending them to an LLM. Protect your privacy without leaving your computer.

★ 1,271 · Python
sums001/Windows-Copilot-API

WINDOWS COPILOT API FREE

Reverse‑engineered Windows Copilot as a compatible OpenAI REST API. Access GPT‑4 and GPT‑5 without keys or payment.

★ 1,270 · Python
HelgeSverre/ollama-gui

OLLAMA GUI: LOCAL CHAT AI

Web interface for chatting with local LLMs via the Ollama API. Allows switching models, keeping chat history, and adjusting generation settings directly in the browser. W

★ 1,270 · TypeScript
waybarrios/vllm-mlx

vllm-mlx LLM Server

OpenAI and Anthropic compatible server for Apple Silicon that runs LLMs and vision models with continuous batching and MCP tool calling, achieving 400+ tokens/s.

★ 1,260 · Python
chunxiaoxx/nautilus-compass

NAUTILUS COMPASS: RELIABLE MULTI-AGENT

Nautilus Compass adds reliability to multi-agent systems without an orchestrator. It provides cross-dialog contracts, detects behavioral drift, and maintains a black-box

★ 1,258 · Python
Tencent/AngelSlim

ANGELSLIM: COMPRESSING MODELS WITHOUT LOSS

A tool for model compression focusing on convenience and efficiency. 1257 stars on GitHub.

★ 1,257 · Python
fastcrw/crw

FAST ALTERNATIVE FIRECRAWL IN RUST

crw — fast Firecrawl/Tavily alternative in Rust: web scraper, crawler and search API with MCP server for AI agents. Compatible API (/scrape, /crawl, /search), runs 2.3× f

★ 1,257 · Rust
NVIDIA/kvpress

KVPRESS: LLM CACHE COMPRESSION

Library for easy compression of LLM KV‑cache, accelerating generation and reducing GPU memory consumption.

★ 1,254 · Python
theopenco/llmgateway

LLMGATEWAY: UNIFIED API FOR ALL LLM

Manage requests to different LLM providers through a single unified interface. 1.2K ⭐ on GitHub.

★ 1,252 · TypeScript
wanxingai/LightAgent

LightAgent: AI Agent with Memory

A lightweight framework for AI agents with memory, MCP, and skills. Supports multi-agent interaction, self-learning, and major LLMs.

★ 1,247 · Python
study8677/antigravity-workspace-template

antigravity-workspace-template - Multi-agent engine for code

Multi-agent knowledge system for Claude Code, Cursor, Codex CLI with answers based on code and file line numbers. Works in any AI IDE.

★ 1,246 · Python
datawhalechina/torch-rechub

RECOMMENDATIONS ON STEROIDS

A framework for recommendation models on PyTorch. Easy to use and easily extensible.

★ 1,242 · Jupyter Notebook

New projects on this topic in Telegram

Telegram →
LLM — page 13 | REDDYX AI