R_REDDYX.XYZ

Llamacpp: open-source projects on GitHub

33 repositories on Llamacpp, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Llama 106Ollama 249Openai 690Gguf 47Chatgpt 314GPT 153Self Hosted 359On Device AI 38Vllm 69Agent 547RAG 533Android 108Ios 90
janhq/jan

Jan: Offline GPT Chat

Open-source ChatGPT analog working fully offline on your PC without internet.

★ 42,498 · TypeScript
khoj-ai/khoj

Your AI second brain

A self-hosted AI assistant that searches the web and your documents, creates agents, and automates research.

★ 34,538 · Python
llmware-ai/llmware

LLMware: RAG framework

Unified framework for building corporate RAG pipelines using compact specialized models.

★ 14,860 · Python
RunanywhereAI/runanywhere-sdks

Local AI SDK Set

Production-ready toolkit for running AI models on a local device.

★ 10,350 · C++
xorbitsai/inference

XINFERENCE - ANY LLM ONE LINE

Replace GPT with any open model by changing just one line of code. Run LLM, multimodal, and speech models via a single production-ready API.

★ 9,318 · Python
cactus-compute/engine

AI FRAME FOR DEVICES

This project offers low-bit quant kernels and runtime for consumer devices on Android/ARM. It solves edge-ai tasks with minimal resources.

★ 6,192 · C++
cactus-compute/cactus

Efficient AI for Mobile Devices

An AI engine with minimal latency for smartphones and wearable devices.

★ 4,949 · C
mostlygeek/llama-swap

LLAMA-SWAP - RELIABLE MODEL REPLACEMENT

Utility for seamless model replacement on local servers (llama.cpp, vLLM, etc.)

★ 4,328 · Go
gptme/gptme

GPTME: YOUR TERMINAL AGENT

An autonomous agent in the terminal using Python, writes code, manages the command line and browses the web. Create your persistent AI assistants in minutes!

★ 4,314 · Python
JohnSnowLabs/spark-nlp

SPARK-NLP - REVOLUTION IN NLP

Spark NLP provides state-of-the-art NLP models and ready-to-use pipelines for scalable text processing in Scala.

★ 4,163 · Scala
SciSharp/LLamaSharp

LLAMASHARP - LOCAL LLM ON C#

A C#/.NET library for efficiently running LLaMA and LLaVA LLM models on a local device.

★ 3,826 · C#
twinnydotdev/twinny

FREE AI CODE FOR VS CODE LIKE COPILOT

VS Code plugin with AI code completion like Copilot, but free and local. Supports Llama, GPT, Claude.

★ 3,699 · TypeScript
PrismML-Eng/Bonsai-demo

BONSAI DEMO SHELL TOOL

Mini-demo of the Bonsai project on Shell — shows how to quickly automate tasks using simple scripts.

★ 3,523 · Shell
Josh-XT/AGiXT

AGiXT: AI Agent Automation

A platform for orchestrating AI agents with adaptive memory, plugins, and support for multiple AI providers.

★ 3,192 · Python
containers/ramalama

RAMALAMA EASY AI LAUNCH

RamaLama is an open Python tool that lets you quickly run any AI models in containers and use them for inference in production.

★ 2,872 · Python
floneum/kalosm

LOCAL AI MODELS IN RUST

Instant and controllable pre-trained AI models running locally. 2205 stars — project gaining popularity.

★ 2,236 · Rust
AtomicBot-ai/Atomic-Chat

LOCAL OPEN-SOURCE AI AGENT

Atomic-Chat is a private AI engine for running LLM locally without internet, fully offline on your computer. ⭐ 967 stars on GitHub.

★ 2,008 · TypeScript
intentee/paddler

PADDLER - Simple LLM Load Balancer

Open load balancer and platform for LLM/VLM service on Rust, running on CPU and GPU with minimal dependencies.

★ 1,693 · Rust
benman1/generative_ai_with_langchain

GENERATIVE_AI_WITH_LANGCHAIN - BUILD PRODUCTION LLM

Notebooks for creating production-ready LLM applications and agents using LangChain and LangGraph. Practical examples from the generative AI book.

★ 1,459 · Jupyter Notebook
awaescher/OllamaSharp

OLLAMA SHARP: EASY AI ACCESS

OllamaSharp is a simple .NET library for integrating with local Ollama models, enabling quick requests and responses.

★ 1,414 · C#
ngxson/wllama

WLLAMA: LLM in Browser, No Server

WebAssembly binding for llama.cpp allows running large language models directly in the browser.

★ 1,392 · TypeScript
XHToken/Spark-X2.6

SPARK-X2.6: AGENTS ON DEVICE

Open Spark-x2.5 model series focused on agentic capabilities. Runs locally on device without cloud. 814 stars on GitHub.

★ 911
huggingface/llm-ls

LLM-LSP SERVER TO CODE COMPLETION

llm-ls — an LSP server in Rust that connects LLMs to any editor for code completion and generation. It supports local models via llama.cpp and remote APIs such as Hugging

★ 887 · Rust
xybrid-ai/xybrid

XYBRID: On-Device AI

xybrid — framework for creating applications with on‑device AI in Rust.

★ 524 · Rust
hybridgroup/yzma

YZMA: Local LLM in Go

Integration of llama.cpp into Go applications for local inference with hardware acceleration. 496 stars on GitHub.

★ 496 · Go
jabberjabberjabber/ImageIndexer

ImageIndexer: Auto-tagging photos via LLM

It indexes images, sends requests to a local LLM, and automatically adds tags to file metadata.

★ 400 · Python
skye-harris/hass_local_openai_llm

LOCAL LLM FOR HOME ASSISTANT

LLM integration in Home Assistant for local OpenAI-compatible servers (llamacpp, vllm, etc.)

★ 313 · Python
llamastash/llamastash

LLAMASTASH TERMINAL LLM MANAGER

llamastash — terminal-native manager for local LLMs with zero overhead. Launches, supervises, and routes GGUF models via a single OpenAI‑compatible endpoint.

★ 299 · Rust
jegly/OfflineLLM

OFFLINE LLM ON ANDROID: FULL PRIVACY

OfflineLLM runs any GGUF models locally via llama.cpp with ARM optimisation. Zero network permissions: encrypted settings, biometric lock, and tamper detection. Supports

★ 291 · Kotlin
raketenkater/ggrun

Not a Llama, no stance

Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.

★ 284 · Go
mgonzs13/llama_ros

LLAMA_ROS ROS 2 LLM

The project combines llama.cpp and llava.cpp with ROS 2, allowing the use of GGUF models for real-time robotics.

★ 268 · C++
SyntheticAutonomicMind/CLIO

CLIO - AI CODING AGENT

CLIO is a terminal AI assistant supporting multiple providers and models, speeding up coding.

★ 233 · Perl
jjang-ai/jangq

JANGQ Quantization for Apple Silicon

JANG — adaptive mixed-precision quantization of GGUF models for MLX on Apple Silicon. Requires using the JANG_Q runtime for maximum performance.

★ 233 · Python

New projects on this topic in Telegram

Telegram →
Llamacpp — 33 open-source GitHub projects | REDDYX AI