AIC★ 691⑂ 23 forksMIT
hyperionaidev/smolmaxxing
SMOLMAXXING: LLM ON MICROCONTROLLERS
C library for running LLMs on microcontrollers and weak hardware. Alternative to llama.cpp focused on minimal memory usage. Supports quantization and various model architectures.
// KEY FEATURES
- Runs LLMs on microcontrollers with 256 KB RAM
- Written in pure C without dependencies
- Supports GGUF, 2-8 bit quantization
- Runs on ARM, RISC-V, x86 bare metal
#edge-ai#llama-cpp#llama-cpp-alternative#llm#local-llm#local-llm-support#on-device#quantization#quantization-algorithms
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram