R_REDDYX.XYZ

LLM: open-source projects on GitHub

2095 repositories on LLM, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

AI Agents 1320MCP 1602Openai 691Claude 978Claude Code 1596Agent 547RAG 533AI Agent 691Anthropic 452Developer Tools 620Agents 400Codex 850Self Hosted 361Agentic AI 378
trefeon/freebucks-proxy

FREEBUCKS PROXY: CODING GATEWAY

Multi-account OpenAI‑compatible gateway for coding models. Supports pooled keys, session lifecycle management, TLS stealth, and an embedded admin dashboard. Works without

★ 297 · Go
T-Crypt/berth

GPU BY TURN WITHOUT CRASHES

Berth leases the GPU to chat, image, and voice engines in turn. Two processes never load together and crash each other. Single Go binary, no dependencies.

★ 297 · Go
strands-agents/mcp-server

MCP SERVER FOR STRANDS AGENTS

MCP server that provides Strands Agents documentation to your AI tools for easy agent coding.

★ 296 · Python
mohitsoni48/TurboLLM

TURBO LLM: OFFLINE WITH AI

Run any local LLM with automatic GPU tuning, a web UI, and an OpenAI/Anthropic‑compatible API.

★ 296 · TypeScript
mrdjohnson/llm-x

LLM-X: THE SIMPLEST WEB-UI

LLMX — the simplest web interface for local LLMs, running directly in the browser. Supports chat bots, integration with Automatic1111, and quick start without complex set

★ 296 · TypeScript
amxv/mcp-manager

MANAGE MCP SERVERS IN CLAUDE

mcp-manager — a web UI on React and Vite to manage MCP servers in Claude. Allows adding, removing, and configuring context protocol servers without editing configs. The p

★ 296 · TypeScript
0xranx/golembot

GOLEMBOT — AGENT EVERYWHERE

Connect any AI agent to any messenger and LLM provider. Cursor, Claude Code, Codex work in Slack, Telegram, Discord and even WeChat.

★ 295 · TypeScript
Yigtwxx/awesome-rag-production

AWESOME RAG PRODUCTION

List of proven tools and practices for building scalable RAG systems in Python.

★ 295 · Python
beehive-lab/jitllm

JITLLM: HIGH PERFORMANCE LLM ON JVM

JITLLM — Java framework for high‑performance LLM inference and serving on the JVM. Supports GPU acceleration, GGUF and quantized model formats, and integration with DeepS

★ 295 · Java
ANDRETRIPOL/OpenGhost

OPEN AI-AGENT FOR DESKTOP

OpenGhost — open AI‑agent for desktop on JavaScript. It has its own agent engine, browser automation tools and a drawing engine that visualizes its explanations. Supports

★ 295 · JavaScript
luqman-v1/9router-go

9ROUTER-GO GATEWAY FOR LLM ROUTING

A high‑performance Go proxy routes LLM requests to Claude, DeepSeek, GPT and other models. It delivers up to 32 000 RPS at only 42 MB RAM, is CGO‑free, and supports flexi

★ 295 · Go
xuwei95/ezdata

EZDATA AI DATA PLATFORM

AI-native platform with 60+ connectors, dlt‑based ETL, DAG scheduler, and sandbox agents for queries, charts, and data analysis.

★ 294 · Python
238SAMIxD/discord-ai-bot

AI BOT FOR DISCORD WITH TYPESCRIPT

TypeScript Discord bot with Ollama integration for LLM and Stable Diffusion for image generation. Supports dialogue context, prompt system and attachment handling. 294 st

★ 294 · TypeScript
myylogic/cevahir-ai

CEVAHIR AI OPEN AI ENGINE

Full-featured open-source engine for training tokenizers, transformers, and cognitive reasoning, ready for chat flow.

★ 293 · Python
smixs/iva-agent

IVA-AGENT YOURAI ASSISTANT

IVA-agent is a self-contained AI assistant in Telegram that stores all your information and helps you manage everyday tasks. It launches with a single command, runs fully

★ 292 · TypeScript
403errors/repomind

REPOMINDS: CHAT WITH CODE

AI assistant for interacting with any public GitHub repository: code analysis, architectural maps, and security audit.

★ 291 · TypeScript
ferro-labs/ai-gateway

AI-GATEWAY: Unified LLM Gateway

Unified AI gateway supporting 30+ LLMs with caching, guardrails, A/B testing, and cost controls. Built in Go for maximum speed and scalability.

★ 291 · Go
jegly/OfflineLLM

OFFLINE LLM ON ANDROID: FULL PRIVACY

OfflineLLM runs any GGUF models locally via llama.cpp with ARM optimisation. Zero network permissions: encrypted settings, biometric lock, and tamper detection. Supports

★ 291 · Kotlin
amscotti/local-LLM-with-RAG

LOCAL LLM RAG: QUICK START

Run local language models and perform retrieval-augmented generation without the cloud.

★ 290 · Python
JetXu-LLM/llama-github

LLAMA GITHUB AI AGENT

A library for LLM agents that extracts context from selected GitHub projects and answers code questions.

★ 290 · Python
1600822305/AetherLink

AETHERLINK AI for All Models

Cross-platform AI assistant supporting OpenAI, Gemini, Claude, and other models. 293 stars on GitHub.

★ 289 · TypeScript
oleksiijko/pmb

MEMORY FOR AI AGENTS

Local persistent memory for Claude Code, Cursor, and Codex via MCP. Solutions, lessons, and facts are stored in a single SQLite file — fully offline and multilingual.

★ 289 · Python
jinzcdev/markmap-mcp-server

MARKMAP MCP SERVER FOR MARKDOWN

Converts Markdown into interactive mind maps with export to PNG, JPG, SVG.

★ 289 · TypeScript
Brain0-ai/brain0

BLACK BOX FOR AI CODE

brain0 links every commit to agent prompts. Detects drift, audits agent data access (DLP), assesses risk from evidence, stores MCP memory, and emits signed provenance att

★ 289 · Rust
ombharatiya/AI-Engineer-Interview-Questions

AI Engineer Interview Prep Kit

Curated interview questions, study maps, and coding challenges for AI/LLM engineering roles with company-specific sets and worked solutions.

★ 289 · Python
codecoradev/uteke

UTEKE: BRAIN FOR AI

Local memory for AI agents: semantic search, storage and recall of memories in one Rust binary with no configuration.

★ 288 · Rust
K-Dense-AI/mimeo

MIMEO: TURN ANY EXPERT INTO AN AGENT

Create AGENT.md and SKILL.md from expert knowledge in your repository. Mimeo analyzes code, documentation, and practices, turning them into instructions for AI agents. Su

★ 288 · Python
rentruewang/bocoel

BOCOEL: BAYESIAN OPTIMIZATION FOR LLM

bocoel — a Bayesian Optimization framework for quick LLM evaluation: 10× faster, just a few lines of code. It replaces costly benchmarks with precise search over model hy

★ 288 · Python
fitchmultz/pi-posthorse

POSTHORSE: CONTEXT WITHOUT SUMMARY

Posthorse provides native context windows without summarization for the fitchmultz/pi fork of the Pi coding agent enabling rollover tools, durable notes, and history reco

★ 288 · TypeScript
jax-ml/jax-llm-examples

JAX-LLM-EXAMPLES - QUICK START

Minimal code, maximum speed: LLM examples in pure JAX for rapid prototyping.

★ 287 · Python
lgalabru/axel

AGENT ORCHESTRATOR AXEL

Rust framework for orchestrating LLM agents in Rex ecosystem. Manages worktrees, integrates with Claude Code and Codex. 210★ on GitHub.

★ 287 · Rust
virtengine/bosun

BOSUN: AUTONOMOUS ENGINEERING

Bosun is a JavaScript framework for autonomous engineering agents that uses LLMs such as GPT‑4, Claude and Codex. It automates writing, testing and refactoring code, inte

★ 286 · JavaScript
mamei16/LLM_Web_search

LLM WEB SEARCH IN OOBABOOGA

Extension for oobabooga/text-generation-webui adding LLM web search via DuckDuckGo. Uses FAISS for result indexing.

★ 286 · Python
yennanliu/InvestSkill

STOCK ANALYSIS SKILLS FOR LLMS

InvestSkill gives LLMs (Claude, Gemini) tools for fundamental analysis of US stocks. The JavaScript project includes agents for fetching financial data and calculating mu

★ 285 · JavaScript
mingchen666/DocTranslator

DOCUMENT TRANSLATOR AI IN PYTHON

DocTranslator is a powerful AI document translation tool. It supports multiple file formats, OpenAI API, batch processing, multithreading, and Docker deployment for fast

★ 285 · Python
allenporter/home-assistant-datasets

DATASETS FOR AI IN HOME ASSISTANT

A collection of datasets for evaluating AI models in the context of a smart home. 222 stars.

★ 284 · Jupyter Notebook
raketenkater/ggrun

Not a Llama, no stance

Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.

★ 284 · Go
digiteinfotech/kairon

Kairon AI Platform

Create proactive digital assistants via Visual LLM chains. Fully written in Python — an open and accessible project.

★ 284 · Python
microsoft/Sico

SICO — NEXT-GENERATION DIGITAL WORKER

Open Digital Worker platform for reliable task execution, continuous co-evolution of AI agents, and building Enterprise AI solutions.

★ 284 · Python
czhou578/llm-god

MULTI-PROMPT FOR LLM ON DESKTOP

llm-god — a desktop app built with Electron/TypeScript that lets you send simultaneous requests to ChatGPT, Gemini, Claude and DeepSeek. Compare answers in real time, sav

★ 284 · TypeScript
alibaba/tair-kvcache

TAIR-KVCACHE: ACCELERATING LLM INFERENCE

A high-performance KV caching system from Alibaba Cloud that accelerates LLM inference.

★ 283 · C++
zenolab124/monet

MONET: Claude Management

Native app for managing Claude Code sessions: view, search, and control code straight from your desktop.

★ 283 · Rust
microsoft/finnts

FINNTS: Financial Forecast in R

Microsoft FinnTS framework for accurate forecasting of financial time series using parallel computing in the cloud.

★ 283 · R
fpytloun/mnemory

MNEMORY: MEMORY FOR AI AGENTS

Self-hosted, secure, feature-rich memory for AI agents and assistants. Extracts facts intelligently, removes duplicates and stores artifacts with full content.

★ 283 · Python
vakovalskii/searcharvester

SEARCHARVESTER: AI AGENT SEARCH AND FETCH

Self‑hosted search engine based on SearXNG (100+ sources) with FastAPI and trafilatura. Tavily‑compatible /search and /extract endpoints with size limits and pagination,

★ 283 · Python
av/awesome-llm-services

BEST LLM SERVICES LIST

A collection of ready-to-deploy LLM services with open-source code in TypeScript.

★ 281 · TypeScript
nirholas/three.ws

THREE WS: 3D AI AGENT

Open-source 3D AI agent framework: GLB/glTF avatars with LLM brain, memory, emotions and autonomous payments. Supports MCP server, x402, Solana/EVM, Three.js, embeddable

★ 281 · JavaScript
edouard-claude/snip

SNIP - TOKEN SAVINGS UP TO 90%

Go-based CLI proxy that reduces LLM token usage by 60-90% with YAML filters for Claude Code, Cursor, Copilot, and Gemini.

★ 280 · Go
sagents-ai/sagents

SAGENTS: AI Agents in Elixir

The sagents project allows creating interactive AI agents in Elixir with OTP supervision, middleware, and Phoenix LiveView integration.

★ 280 · Elixir
InternScience/ResearchClawBench

RESEARCHCLAWBENCH - IMPROVING AI RESEARCH EFFECTIVENESS

Evaluation of automated AI agents: from rediscovery to new discoveries. Runs in Jupyter Notebook.

★ 280 · Jupyter Notebook
SecurityClaw/SecurityClaw

SECURITYCLAW AUTONOMOUS SOC AGENT

Modular SOC agent on Python, monitors OpenSearch/Elasticsearch, builds RAG memory and validates anomalies with LLMs.

★ 280 · Python
JosefAlbers/phi

phi - Simple Phi-4 Launch

Run the powerful multimodal Phi-4 model directly on your Mac with Apple Silicon — no cloud, no complex setup.

★ 280 · Jupyter Notebook
AIFrontierLab/AgentArk

AGENTARK: ONE LLM INSTEAD OF MANY AGENTS

Official AgentArk implementation from CMU and Georgia Tech. Method distills multi-agent intelligence into a single LLM agent preserving task quality. Python code, 260 Git

★ 280 · Python
haseeb-heaven/open-agent

open-agent - FREE AGENT FOR ALL

open-agent offers 60+ models, free plans, local LLMs and a Docker sandbox — your agent, your rules.

★ 279 · TypeScript
pinecone-io/pinecone-ts-client

Official Pinecone TS Client

Official TypeScript client for Pinecone vector database. Simple integration and full API support.

★ 279 · TypeScript
llm4s/llm4s

LLM AGENTS IN SCALA

llm4s is a library for building LLM agents in Scala with type safety. Supports Anthropic, Gemini, and Java interop. 272 stars on GitHub.

★ 279 · Scala
microsoft/monitors4codegen

MONITOR-GUIDED DECODING FOR CODE LLM

NeurIPS 2023 artifact: Monitor-Guided Decoding of code LMs with static analysis of repository context. Includes multispy — Python LSP client for language server integrati

★ 279 · Python
Dongbumlee/ontosmith

Decision-Based Knowledge Graph Builder

Builds governed knowledge graphs from documents using decision models, with every fact traceable to source evidence.

★ 279 · Python
aspasskiy/GoGogot

GOGOGOT: AI AGENT ON GO

GoGogot — lightweight self‑hosted AI agent in Go that you can run locally and use instead of OpenClaw. It understands natural instructions, executes bash commands, works

★ 278 · Go
autonomous-ai/autonomous-grid

BUILD YOUR AI INTRANET

Autonomous grid unites your computers into a single infrastructure for running AI models: training, fine‑tuning and inference. Supports distributed computing, fine‑tuning

★ 278 · Python

New projects on this topic in Telegram

Telegram →
LLM — page 29 | REDDYX AI