R_REDDYX.XYZ

Edge AI: open-source projects on GitHub

19 repositories on Edge AI, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094On Device AI 38Android 108Llama Cpp 56Ios 90RAG 533Llamacpp 33Local AI 82Local LLM 107LLM Inference 76MCP 1601Self Hosted 359AI Agent 690Gguf 47
cactus-compute/engine

AI FRAME FOR DEVICES

This project offers low-bit quant kernels and runtime for consumer devices on Android/ARM. It solves edge-ai tasks with minimal resources.

★ 6,192 · C++
cactus-compute/cactus

Efficient AI for Mobile Devices

An AI engine with minimal latency for smartphones and wearable devices.

★ 4,949 · C
beclab/Olares

OLARES — YOUR OWN DATA CLOUD

Olares — an open personal cloud platform written in Go for complete control over your data.

★ 4,558 · Go
0xShug0/audio.cpp

Pure C++ Audio Inference Engine

All-in-one C++ inference engine for audio models (TTS, STT, VAD, voice conversion, music generation) powered by ggml, with zero Python dependencies and highly optimized p

★ 4,234 · C++
FedML-AI/FedML

Universal FedML Platform

A universal library for distributed training, model serving, and federated learning with a cross-cloud scheduler.

★ 4,046 · Python
off-grid-ai/OGAM

OGAM Offline AI Swiss Knife

OGAM — chat, vision, speech, and image generation offline on your device without keys or network data.

★ 3,380 · TypeScript
usamahz/cpu-performance-engineering

From Instructions to Inference

A C reading path from one instruction to production inference, using primary sources and runnable benchmarks for each section.

★ 1,160 · C
OpenSparX/MasterAgent

MASTERAGENT - POWERFUL OFFLINE AI AGENT

MasterAgent enables creating AI agents that run fully on‑device with sub‑100ms latency on Qualcomm NPU, requiring no cloud.

★ 976 · C++
feder-cr/jev

JEVOS: BINARY DECISIONS ON LAPTOP

Jevos is an open-source Jev alternative for yes/no decisions. Runs fully locally on CPU via FastAPI. Data never leaves your device.

★ 963 · Python
Helldez/BigMoeOnEdge

BIGMOEONEDGE - SUPER MOE ON PHONE

The project enables running 284 B Mixture‑of‑Experts models on a device with 12 GB of RAM, using only CPU and llama.cpp without loss of accuracy.

★ 855 · C++
hyperionaidev/smolmaxxing

SMOLMAXXING: LLM ON MICROCONTROLLERS

C library for running LLMs on microcontrollers and weak hardware. Alternative to llama.cpp focused on minimal memory usage. Supports quantization and various model archit

★ 691 · C
DenisovAV/flutter_edge_ai

FLUTTER EDGE AI: RIGHT ON DEVICE

On-device AI for Flutter: Gemma and other LLMs, multimodality, function calling, embeddings, RAG and speech. Supported on Android, iOS, Web, macOS, Windows and Linux.

★ 663 · JavaScript
xybrid-ai/xybrid

XYBRID: On-Device AI

xybrid — framework for creating applications with on‑device AI in Rust.

★ 524 · Rust
varun29ankuS/shodh-memory

SHODH-MEMORY - SMART MEMORY FOR AI

Shodh-memory is a cognitive memory for AI agents: learns from experience, forgets the irrelevant, strengthens important memories. One binary, fully offline.

★ 323 · Rust
ThinkOffApp/CarWatch

CARWATCH AI AGENT CAR

CarWatch turns Raspberry Pi 5, a dashcam, and local AI into a chat agent for your car. Talk to the vehicle, get data, and control functions in real time. This is a CodeWa

★ 305 · Python
jegly/OfflineLLM

OFFLINE LLM ON ANDROID: FULL PRIVACY

OfflineLLM runs any GGUF models locally via llama.cpp with ARM optimisation. Zero network permissions: encrypted settings, biometric lock, and tamper detection. Supports

★ 291 · Kotlin
AbrahamPaulJ/nightmare-mobile

On-Device Mobile Diffusion Studio

Run ComfyUI-style node graphs for SDXL, Flux, and 14B video models locally on Android via Qualcomm NPU. Fully offline with inpainting, ControlNet, LoRA, and IPAdapter sup

★ 233 · Kotlin
llamatik/Llamatik

ON-DEVICE AI SDK KOTLIN

Llamatik is an on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). Supports LLM inference, Speech-to-Text, image generation, Agent Framework and

★ 220 · Kotlin
wmaslonek/guardian-db

GUARDIANDB RUST DECENTRALIZED DB

GuardianDB is a fast local decentralized database built on Rust and Iroh, offering high‑performance storage and data processing.

★ 214 · Rust

New projects on this topic in Telegram

Telegram →
Edge AI — 19 open-source GitHub projects | REDDYX AI