AIRust★ 206
timtoole02/Camelid
CAMELID: LOCAL AI ON RUST
Camelid — a Rust‑native backend for local inference, compatible with models via evidence‑gated compatibility. Supports Apple Silicon, GGUF, Llama and other LLMs, runs fully offline. Already 200+ stars on GitHub.
// KEY FEATURES
- Performs local LLM inference in pure Rust, without servers or external dependencies.
- Supports GGUF models on Apple Silicon with optimized kernels for ARM.
- Verifies model evidence‑gated compatibility before loading, ensuring correctness.
- Runs fully offline, ideal for local‑first scenarios and edge devices.
#apple-silicon#gguf#inference#llama#llm#local-first#metal#openai-compatible#quantization#rust#windows
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram