R_REDDYX.XYZ
AIRust★ 68⑂ 4 forksApache-2.0

1picassoai/coachwhip

Mixture-of-Experts LLM Engine

Runs an 80‑billion‑parameter mixture‑of‑experts language model on Apple Silicon, fitting within 16 GB RAM.

// KEY FEATURES

  • Executes MoE inference with expert routing optimized for Apple’s Neural Engine.
  • Loads 80B parameter model using quantized weights, staying under 16 GB memory.
  • Provides low‑latency text generation via Rust‑based async pipeline on macOS.
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

AI for Designers★ 68AWESOME-AGENT-EVOLUTION: AGENT EVOLUTION MAP★ 68Ontological E-commerce Analytics★ 68Rust Inference Engine for AMD R9700★ 68🤖 Skills for Engineers★ 69QuantumFlow: Distributed LLM Inference★ 69

← FULL CATALOG

1picassoai/coachwhip — Mixture-of-Experts LLM Engine