R_REDDYX.XYZ

Llama: open-source projects on GitHub

106 repositories on Llama, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Openai 690GPT 153Ollama 249Mistral 40Deepseek 229Qwen 106Chatgpt 314Anthropic 452Chatbot 168Gemini 348MCP 1602Llama3 28Claude 978
FastFlowLM/FastFlowLM

FAST LLM ON AMD

Run LLM on AMD Ryzen™ AI in minutes. Like Ollama, but deeply optimized for AMD chips! C++

★ 1,464 · C++
awaescher/OllamaSharp

OLLAMA SHARP: EASY AI ACCESS

OllamaSharp is a simple .NET library for integrating with local Ollama models, enabling quick requests and responses.

★ 1,414 · C#
alibaba/rtp-llm

RTP-LLM ENHANCED LLM INFERENCE

High-performance LLM inference engine from Alibaba, written in CUDA, enables fast model operation across diverse applications.

★ 1,400 · Cuda
explosion/spacy-llm

LLM IN SPACY PIPELINE PAINLESSLY

spacy-llm connects GPT, Claude, Cohere and open models to spaCy pipeline. Configure via config, get structured Doc with entities and relations. No wrapper code — pure NLP

★ 1,399 · Python
ngxson/wllama

WLLAMA: LLM in Browser, No Server

WebAssembly binding for llama.cpp allows running large language models directly in the browser.

★ 1,392 · TypeScript
maziyarpanahi/openmed

OpenMed AI for Healthcare

OpenMed is an open-source Python project using AI for medical data analysis and clinical decision support.

★ 1,365 · Python
ggml-org/llama.vscode

LLM CODE COMPLETION

VS Code extension for LLM-powered code and text autocompletion. 1359 stars on GitHub.

★ 1,359 · TypeScript
GradientHQ/parallax

PARALLAX: BUILD AI CLUSTER

Parallax lets you quickly deploy a distributed inference service on any infrastructure.

★ 1,301 · Python
fatwang2/search2ai

SEARCH2AI - Smart Search for LLM

Connect web search to your LLMs and get up-to-date answers in real time.

★ 1,288 · JavaScript
strands-agents/tools

POWERFUL TOOLS FOR AGENTS

A set of Python tools that extend the capabilities of AI agents.

★ 1,089 · Python
mybigday/llama.rn

LLAMA NOW IN REACT NATIVE

llama.rn is a React Native binding for llama.cpp, enabling LLM models to run directly on mobile devices. 981 stars on GitHub.

★ 1,074 · C++
raiyanyahya/how-to-train-your-gpt

How to Train Your LLM

Build a modern LLM from scratch — every line of code is commented and explained simply, as if for a five-year-old.

★ 984 · Jupyter Notebook
kardolus/chatgpt-cli

CHATGPT CLI: POWERFUL LLM CLIENT

Command line for working with many LLM providers: OpenAI, Azure, Perplexity, LLaMA, and others.

★ 966 · Go
curiousily/AI-Bootcamp

AI-BOOTCAMP — YOUR PATH INTO AI

Self-paced GenAI bootcamp: from ML basics to AI agents. 909 ⭐ on GitHub. Jupyter Notebooks, hands‑on with top models.

★ 959 · Jupyter Notebook
hexabot-ai/Hexabot

Hexabot v3 AI platform

Hexabot v3 combines workflows, actions, agents, and conversational channels in a single environment for automating AI tasks.

★ 952 · TypeScript
strands-agents/samples

STRANDS AGENT SAMPLES

Examples of agents created with the Strands Agents SDK in Python. Ready-made templates for quick start of AI agent development.

★ 940 · Python
jakobdylanc/llmcord

LLMCORD: Discord as LLM Interface

Connect any model via OpenAI-compatible API to Discord and chat with AI right in chat.

★ 843 · Python
bolna-ai/bolna

CREATE VOICE AI AGENTS

Python library for creating voice AI agents with real-time support.

★ 827 · Python
invergent-ai/surogate

SURROGATE — POWERFUL FINE-TUNING IN C++

Training and fine-tuning models at the speed of light. 796 stars on GitHub.

★ 796 · C++
Ryan-yang125/ChatLLM-Web

PRIVATE CHAT AI

Local AI chat in the browser using WebGPU and WebLLM, with no servers or cloud data.

★ 642 · TypeScript
nodetool-ai/nodetool

NODETOOL: YOUR AI WORKSPACE

Open workspace for creative AI: create, edit, and share models right in the browser.

★ 637 · TypeScript
zhudotexe/kani

KANI: MICROFRAMEWORK FOR LLM TOOLS

Kani — a Python microframework for building tool‑calling agents with support for GPT‑4, Llama and other LLMs. It lets you quickly connect arbitrary functions and tools vi

★ 613 · Python
NVIDIA-NeMo/Automodel

AUTOMODEL — DISTRIBUTED LLM/VLM TRAINING

Native PyTorch library for distributed LLM/VLM training with out-of-the-box Hugging Face support. ⭐ 576 stars on GitHub.

★ 576 · Python
kaito-project/aikit

Survive LLM Chaos

Open-source Go tool for fine-tuning, building, and deploying LLMs with a single command.

★ 545 · Go
tak-bro/aicommit2

AICOMMIT2 - AI GENERATES COMMITS

Aicommit2 is a fast CLI that uses AI models (Ollama, ChatGPT, Gemini, etc.) to automatically generate meaningful commit messages in Git and Jujutsu.

★ 533 · TypeScript
ome-projects/ome

LLM Serving in Kubernetes

OME is an operator for running LLMs in Kubernetes with smart GPU scheduling and support for SGLang, vLLM, TensorRT-LLM, and Triton.

★ 527 · Go
apocas/restai

OPEN-SOURCE AIaaS PLATFORM

RESTai — an AIaaS platform with Ollama/vLLM support, built-in image and audio generation, visual block programming, and analytics.

★ 520 · Python
hybridgroup/yzma

YZMA: Local LLM in Go

Integration of llama.cpp into Go applications for local inference with hardware acceleration. 496 stars on GitHub.

★ 496 · Go
lechmazur/writing

WRITING BENCHMARK – LOVED ELEMENTS

Tests how AI weaves 10 mandatory plot elements into a short story.

★ 470
AndraxDev/speak-gpt

SPEAK-GPT - Your Personal Assistant

A voice assistant built with Kotlin that uses OpenAI ChatGPT for natural dialogue.

★ 447 · Kotlin
PocketRisu/PocketRisu

POCKETRISU - SELF‑BUILT AI CHAT

PocketRisu is a self‑hosted platform for AI role‑play chats, a fork of Risuai that runs on your PC or personal server.

★ 444 · TypeScript
FuJacob/cotabby

COTABBY AI AutoComplete Mac

Local AI autocomplete for your entire Mac — works offline everywhere you type, with open-source Swift code.

★ 395 · Swift
sammcj/ingest

PARSE CODE FOR AI

The ingest project lets you quickly extract code from repositories and websites, sending the result to the clipboard or a file for further AI processing.

★ 388 · Go
e2b-dev/ai-analyst

OPEN AI ANALYST ON E2B

Open source AI analyst on E2B analyzes CSV files via Llama 3.1 and builds interactive charts. Written in TypeScript, it already has 384★.

★ 386 · TypeScript
barun-saha/slide-deck-ai

CREATE PRESENTATION WITH AI

slide-deck-ai is a Python library that generates PowerPoint presentations with AI, saving time and effort.

★ 378 · Python
Picovoice/picollm

PICOLLM - OFFLINE LLM ON DEVICE

picollm enables running LLM on-device through extreme k‑bit quantization, delivering fast and private inference without the cloud.

★ 320 · Python
strands-agents/mcp-server

MCP SERVER FOR STRANDS AGENTS

MCP server that provides Strands Agents documentation to your AI tools for easy agent coding.

★ 296 · Python
mgonzs13/llama_ros

LLAMA_ROS ROS 2 LLM

The project combines llama.cpp and llava.cpp with ROS 2, allowing the use of GGUF models for real-time robotics.

★ 268 · C++
ClawLabsAI/free-ai-models

COLLECTION OF FREE AI MODELS

Daily‑updated list of free AI models (LLM API), ranked by quality with live status. A single OpenAI‑compatible endpoint automatically routes requests to the best availabl

★ 267 · JavaScript
jontsai/openclaw-command-center

CONTROL AI AGENTS COMMAND CENTER NOW

The control panel for AI agents: launch, coordinate, and monitor numerous agents in real time. It supports integration with Anthropic Claude and workflow automation via p

★ 250 · JavaScript
yoshoku/llama_cpp.rb

LLAMA_CPP.RB Ruby Bindings

Ruby wrapper for llama.cpp, allowing you to run large language models directly from Ruby code.

★ 236 · C
cgbur/llama2.zig

LLAMA2 IN ONE ZIG FILE

The llama2.zig project lets you run Llama 2 inference in a single file using pure Zig, with no dependencies.

★ 225 · Zig
timtoole02/Camelid

CAMELID: LOCAL AI ON RUST

Camelid — a Rust‑native backend for local inference, compatible with models via evidence‑gated compatibility. Supports Apple Silicon, GGUF, Llama and other LLMs, runs ful

★ 221 · Rust
llamatik/Llamatik

ON-DEVICE AI SDK KOTLIN

Llamatik is an on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). Supports LLM inference, Speech-to-Text, image generation, Agent Framework and

★ 220 · Kotlin
ad-si/cai

CAI - HASSLE-FREE AI RESULTS

cai is a simple CLI tool in Rust that automates LLM work: set a goal, get a result without prompts.

★ 204 · Rust
DevDock-AI/Speedy

125B MoE Inference on RTX

Run Qwen3.8-Flash-Next (125B MoE) with 1M context on one or two RTX 3080 10GB cards. Tuned, benchmarked fork of Strata.

★ 71 · C++

New projects on this topic in Telegram

Telegram →
Llama — page 2 | REDDYX AI