Llamacpp: open-source projects on GitHub
33 repositories on Llamacpp, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
Jan: Offline GPT Chat
Open-source ChatGPT analog working fully offline on your PC without internet.
★ 42,498 · TypeScriptYour AI second brain
A self-hosted AI assistant that searches the web and your documents, creates agents, and automates research.
★ 34,538 · PythonLLMware: RAG framework
Unified framework for building corporate RAG pipelines using compact specialized models.
★ 14,860 · PythonLocal AI SDK Set
Production-ready toolkit for running AI models on a local device.
★ 10,350 · C++XINFERENCE - ANY LLM ONE LINE
Replace GPT with any open model by changing just one line of code. Run LLM, multimodal, and speech models via a single production-ready API.
★ 9,318 · PythonAI FRAME FOR DEVICES
This project offers low-bit quant kernels and runtime for consumer devices on Android/ARM. It solves edge-ai tasks with minimal resources.
★ 6,192 · C++Efficient AI for Mobile Devices
An AI engine with minimal latency for smartphones and wearable devices.
★ 4,949 · CLLAMA-SWAP - RELIABLE MODEL REPLACEMENT
Utility for seamless model replacement on local servers (llama.cpp, vLLM, etc.)
★ 4,328 · GoGPTME: YOUR TERMINAL AGENT
An autonomous agent in the terminal using Python, writes code, manages the command line and browses the web. Create your persistent AI assistants in minutes!
★ 4,314 · PythonSPARK-NLP - REVOLUTION IN NLP
Spark NLP provides state-of-the-art NLP models and ready-to-use pipelines for scalable text processing in Scala.
★ 4,163 · ScalaLLAMASHARP - LOCAL LLM ON C#
A C#/.NET library for efficiently running LLaMA and LLaVA LLM models on a local device.
★ 3,826 · C#FREE AI CODE FOR VS CODE LIKE COPILOT
VS Code plugin with AI code completion like Copilot, but free and local. Supports Llama, GPT, Claude.
★ 3,699 · TypeScriptBONSAI DEMO SHELL TOOL
Mini-demo of the Bonsai project on Shell — shows how to quickly automate tasks using simple scripts.
★ 3,523 · ShellAGiXT: AI Agent Automation
A platform for orchestrating AI agents with adaptive memory, plugins, and support for multiple AI providers.
★ 3,192 · PythonRAMALAMA EASY AI LAUNCH
RamaLama is an open Python tool that lets you quickly run any AI models in containers and use them for inference in production.
★ 2,872 · PythonLOCAL AI MODELS IN RUST
Instant and controllable pre-trained AI models running locally. 2205 stars — project gaining popularity.
★ 2,236 · RustLOCAL OPEN-SOURCE AI AGENT
Atomic-Chat is a private AI engine for running LLM locally without internet, fully offline on your computer. ⭐ 967 stars on GitHub.
★ 2,008 · TypeScriptPADDLER - Simple LLM Load Balancer
Open load balancer and platform for LLM/VLM service on Rust, running on CPU and GPU with minimal dependencies.
★ 1,693 · RustGENERATIVE_AI_WITH_LANGCHAIN - BUILD PRODUCTION LLM
Notebooks for creating production-ready LLM applications and agents using LangChain and LangGraph. Practical examples from the generative AI book.
★ 1,459 · Jupyter NotebookOLLAMA SHARP: EASY AI ACCESS
OllamaSharp is a simple .NET library for integrating with local Ollama models, enabling quick requests and responses.
★ 1,414 · C#WLLAMA: LLM in Browser, No Server
WebAssembly binding for llama.cpp allows running large language models directly in the browser.
★ 1,392 · TypeScriptSPARK-X2.6: AGENTS ON DEVICE
Open Spark-x2.5 model series focused on agentic capabilities. Runs locally on device without cloud. 814 stars on GitHub.
★ 911LLM-LSP SERVER TO CODE COMPLETION
llm-ls — an LSP server in Rust that connects LLMs to any editor for code completion and generation. It supports local models via llama.cpp and remote APIs such as Hugging
★ 887 · RustXYBRID: On-Device AI
xybrid — framework for creating applications with on‑device AI in Rust.
★ 524 · RustYZMA: Local LLM in Go
Integration of llama.cpp into Go applications for local inference with hardware acceleration. 496 stars on GitHub.
★ 496 · GoImageIndexer: Auto-tagging photos via LLM
It indexes images, sends requests to a local LLM, and automatically adds tags to file metadata.
★ 400 · PythonLOCAL LLM FOR HOME ASSISTANT
LLM integration in Home Assistant for local OpenAI-compatible servers (llamacpp, vllm, etc.)
★ 313 · PythonLLAMASTASH TERMINAL LLM MANAGER
llamastash — terminal-native manager for local LLMs with zero overhead. Launches, supervises, and routes GGUF models via a single OpenAI‑compatible endpoint.
★ 299 · RustOFFLINE LLM ON ANDROID: FULL PRIVACY
OfflineLLM runs any GGUF models locally via llama.cpp with ARM optimisation. Zero network permissions: encrypted settings, biometric lock, and tamper detection. Supports
★ 291 · KotlinNot a Llama, no stance
Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.
★ 284 · GoLLAMA_ROS ROS 2 LLM
The project combines llama.cpp and llava.cpp with ROS 2, allowing the use of GGUF models for real-time robotics.
★ 268 · C++CLIO - AI CODING AGENT
CLIO is a terminal AI assistant supporting multiple providers and models, speeding up coding.
★ 233 · PerlJANGQ Quantization for Apple Silicon
JANG — adaptive mixed-precision quantization of GGUF models for MLX on Apple Silicon. Requires using the JANG_Q runtime for maximum performance.
★ 233 · PythonNew projects on this topic in Telegram
Telegram →