Llama: open-source projects on GitHub
106 repositories on Llama, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
FAST LLM ON AMD
Run LLM on AMD Ryzen™ AI in minutes. Like Ollama, but deeply optimized for AMD chips! C++
★ 1,464 · C++OLLAMA SHARP: EASY AI ACCESS
OllamaSharp is a simple .NET library for integrating with local Ollama models, enabling quick requests and responses.
★ 1,414 · C#RTP-LLM ENHANCED LLM INFERENCE
High-performance LLM inference engine from Alibaba, written in CUDA, enables fast model operation across diverse applications.
★ 1,400 · CudaLLM IN SPACY PIPELINE PAINLESSLY
spacy-llm connects GPT, Claude, Cohere and open models to spaCy pipeline. Configure via config, get structured Doc with entities and relations. No wrapper code — pure NLP
★ 1,399 · PythonWLLAMA: LLM in Browser, No Server
WebAssembly binding for llama.cpp allows running large language models directly in the browser.
★ 1,392 · TypeScriptOpenMed AI for Healthcare
OpenMed is an open-source Python project using AI for medical data analysis and clinical decision support.
★ 1,365 · PythonLLM CODE COMPLETION
VS Code extension for LLM-powered code and text autocompletion. 1359 stars on GitHub.
★ 1,359 · TypeScriptPARALLAX: BUILD AI CLUSTER
Parallax lets you quickly deploy a distributed inference service on any infrastructure.
★ 1,301 · PythonSEARCH2AI - Smart Search for LLM
Connect web search to your LLMs and get up-to-date answers in real time.
★ 1,288 · JavaScriptPOWERFUL TOOLS FOR AGENTS
A set of Python tools that extend the capabilities of AI agents.
★ 1,089 · PythonLLAMA NOW IN REACT NATIVE
llama.rn is a React Native binding for llama.cpp, enabling LLM models to run directly on mobile devices. 981 stars on GitHub.
★ 1,074 · C++How to Train Your LLM
Build a modern LLM from scratch — every line of code is commented and explained simply, as if for a five-year-old.
★ 984 · Jupyter NotebookCHATGPT CLI: POWERFUL LLM CLIENT
Command line for working with many LLM providers: OpenAI, Azure, Perplexity, LLaMA, and others.
★ 966 · GoAI-BOOTCAMP — YOUR PATH INTO AI
Self-paced GenAI bootcamp: from ML basics to AI agents. 909 ⭐ on GitHub. Jupyter Notebooks, hands‑on with top models.
★ 959 · Jupyter NotebookHexabot v3 AI platform
Hexabot v3 combines workflows, actions, agents, and conversational channels in a single environment for automating AI tasks.
★ 952 · TypeScriptSTRANDS AGENT SAMPLES
Examples of agents created with the Strands Agents SDK in Python. Ready-made templates for quick start of AI agent development.
★ 940 · PythonLLMCORD: Discord as LLM Interface
Connect any model via OpenAI-compatible API to Discord and chat with AI right in chat.
★ 843 · PythonCREATE VOICE AI AGENTS
Python library for creating voice AI agents with real-time support.
★ 827 · PythonSURROGATE — POWERFUL FINE-TUNING IN C++
Training and fine-tuning models at the speed of light. 796 stars on GitHub.
★ 796 · C++PRIVATE CHAT AI
Local AI chat in the browser using WebGPU and WebLLM, with no servers or cloud data.
★ 642 · TypeScriptNODETOOL: YOUR AI WORKSPACE
Open workspace for creative AI: create, edit, and share models right in the browser.
★ 637 · TypeScriptKANI: MICROFRAMEWORK FOR LLM TOOLS
Kani — a Python microframework for building tool‑calling agents with support for GPT‑4, Llama and other LLMs. It lets you quickly connect arbitrary functions and tools vi
★ 613 · PythonAUTOMODEL — DISTRIBUTED LLM/VLM TRAINING
Native PyTorch library for distributed LLM/VLM training with out-of-the-box Hugging Face support. ⭐ 576 stars on GitHub.
★ 576 · PythonSurvive LLM Chaos
Open-source Go tool for fine-tuning, building, and deploying LLMs with a single command.
★ 545 · GoAICOMMIT2 - AI GENERATES COMMITS
Aicommit2 is a fast CLI that uses AI models (Ollama, ChatGPT, Gemini, etc.) to automatically generate meaningful commit messages in Git and Jujutsu.
★ 533 · TypeScriptLLM Serving in Kubernetes
OME is an operator for running LLMs in Kubernetes with smart GPU scheduling and support for SGLang, vLLM, TensorRT-LLM, and Triton.
★ 527 · GoOPEN-SOURCE AIaaS PLATFORM
RESTai — an AIaaS platform with Ollama/vLLM support, built-in image and audio generation, visual block programming, and analytics.
★ 520 · PythonYZMA: Local LLM in Go
Integration of llama.cpp into Go applications for local inference with hardware acceleration. 496 stars on GitHub.
★ 496 · GoWRITING BENCHMARK – LOVED ELEMENTS
Tests how AI weaves 10 mandatory plot elements into a short story.
★ 470SPEAK-GPT - Your Personal Assistant
A voice assistant built with Kotlin that uses OpenAI ChatGPT for natural dialogue.
★ 447 · KotlinPOCKETRISU - SELF‑BUILT AI CHAT
PocketRisu is a self‑hosted platform for AI role‑play chats, a fork of Risuai that runs on your PC or personal server.
★ 444 · TypeScriptCOTABBY AI AutoComplete Mac
Local AI autocomplete for your entire Mac — works offline everywhere you type, with open-source Swift code.
★ 395 · SwiftPARSE CODE FOR AI
The ingest project lets you quickly extract code from repositories and websites, sending the result to the clipboard or a file for further AI processing.
★ 388 · GoOPEN AI ANALYST ON E2B
Open source AI analyst on E2B analyzes CSV files via Llama 3.1 and builds interactive charts. Written in TypeScript, it already has 384★.
★ 386 · TypeScriptCREATE PRESENTATION WITH AI
slide-deck-ai is a Python library that generates PowerPoint presentations with AI, saving time and effort.
★ 378 · PythonPICOLLM - OFFLINE LLM ON DEVICE
picollm enables running LLM on-device through extreme k‑bit quantization, delivering fast and private inference without the cloud.
★ 320 · PythonMCP SERVER FOR STRANDS AGENTS
MCP server that provides Strands Agents documentation to your AI tools for easy agent coding.
★ 296 · PythonLLAMA_ROS ROS 2 LLM
The project combines llama.cpp and llava.cpp with ROS 2, allowing the use of GGUF models for real-time robotics.
★ 268 · C++COLLECTION OF FREE AI MODELS
Daily‑updated list of free AI models (LLM API), ranked by quality with live status. A single OpenAI‑compatible endpoint automatically routes requests to the best availabl
★ 267 · JavaScriptCONTROL AI AGENTS COMMAND CENTER NOW
The control panel for AI agents: launch, coordinate, and monitor numerous agents in real time. It supports integration with Anthropic Claude and workflow automation via p
★ 250 · JavaScriptLLAMA_CPP.RB Ruby Bindings
Ruby wrapper for llama.cpp, allowing you to run large language models directly from Ruby code.
★ 236 · CLLAMA2 IN ONE ZIG FILE
The llama2.zig project lets you run Llama 2 inference in a single file using pure Zig, with no dependencies.
★ 225 · ZigCAMELID: LOCAL AI ON RUST
Camelid — a Rust‑native backend for local inference, compatible with models via evidence‑gated compatibility. Supports Apple Silicon, GGUF, Llama and other LLMs, runs ful
★ 221 · RustON-DEVICE AI SDK KOTLIN
Llamatik is an on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). Supports LLM inference, Speech-to-Text, image generation, Agent Framework and
★ 220 · KotlinCAI - HASSLE-FREE AI RESULTS
cai is a simple CLI tool in Rust that automates LLM work: set a goal, get a result without prompts.
★ 204 · Rust125B MoE Inference on RTX
Run Qwen3.8-Flash-Next (125B MoE) with 1M context on one or two RTX 3080 10GB cards. Tuned, benchmarked fork of Strata.
★ 71 · C++New projects on this topic in Telegram
Telegram →