Edge AI: open-source projects on GitHub
19 repositories on Edge AI, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
AI FRAME FOR DEVICES
This project offers low-bit quant kernels and runtime for consumer devices on Android/ARM. It solves edge-ai tasks with minimal resources.
★ 6,192 · C++Efficient AI for Mobile Devices
An AI engine with minimal latency for smartphones and wearable devices.
★ 4,949 · COLARES — YOUR OWN DATA CLOUD
Olares — an open personal cloud platform written in Go for complete control over your data.
★ 4,558 · GoPure C++ Audio Inference Engine
All-in-one C++ inference engine for audio models (TTS, STT, VAD, voice conversion, music generation) powered by ggml, with zero Python dependencies and highly optimized p
★ 4,234 · C++Universal FedML Platform
A universal library for distributed training, model serving, and federated learning with a cross-cloud scheduler.
★ 4,046 · PythonOGAM Offline AI Swiss Knife
OGAM — chat, vision, speech, and image generation offline on your device without keys or network data.
★ 3,380 · TypeScriptFrom Instructions to Inference
A C reading path from one instruction to production inference, using primary sources and runnable benchmarks for each section.
★ 1,160 · CMASTERAGENT - POWERFUL OFFLINE AI AGENT
MasterAgent enables creating AI agents that run fully on‑device with sub‑100ms latency on Qualcomm NPU, requiring no cloud.
★ 976 · C++JEVOS: BINARY DECISIONS ON LAPTOP
Jevos is an open-source Jev alternative for yes/no decisions. Runs fully locally on CPU via FastAPI. Data never leaves your device.
★ 963 · PythonBIGMOEONEDGE - SUPER MOE ON PHONE
The project enables running 284 B Mixture‑of‑Experts models on a device with 12 GB of RAM, using only CPU and llama.cpp without loss of accuracy.
★ 855 · C++SMOLMAXXING: LLM ON MICROCONTROLLERS
C library for running LLMs on microcontrollers and weak hardware. Alternative to llama.cpp focused on minimal memory usage. Supports quantization and various model archit
★ 691 · CFLUTTER EDGE AI: RIGHT ON DEVICE
On-device AI for Flutter: Gemma and other LLMs, multimodality, function calling, embeddings, RAG and speech. Supported on Android, iOS, Web, macOS, Windows and Linux.
★ 663 · JavaScriptXYBRID: On-Device AI
xybrid — framework for creating applications with on‑device AI in Rust.
★ 524 · RustSHODH-MEMORY - SMART MEMORY FOR AI
Shodh-memory is a cognitive memory for AI agents: learns from experience, forgets the irrelevant, strengthens important memories. One binary, fully offline.
★ 323 · RustCARWATCH AI AGENT CAR
CarWatch turns Raspberry Pi 5, a dashcam, and local AI into a chat agent for your car. Talk to the vehicle, get data, and control functions in real time. This is a CodeWa
★ 305 · PythonOFFLINE LLM ON ANDROID: FULL PRIVACY
OfflineLLM runs any GGUF models locally via llama.cpp with ARM optimisation. Zero network permissions: encrypted settings, biometric lock, and tamper detection. Supports
★ 291 · KotlinOn-Device Mobile Diffusion Studio
Run ComfyUI-style node graphs for SDXL, Flux, and 14B video models locally on Android via Qualcomm NPU. Fully offline with inpainting, ControlNet, LoRA, and IPAdapter sup
★ 233 · KotlinON-DEVICE AI SDK KOTLIN
Llamatik is an on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). Supports LLM inference, Speech-to-Text, image generation, Agent Framework and
★ 220 · KotlinGUARDIANDB RUST DECENTRALIZED DB
GuardianDB is a fast local decentralized database built on Rust and Iroh, offering high‑performance storage and data processing.
★ 214 · RustNew projects on this topic in Telegram
Telegram →