AISwift★ 258⑂ 31 forksGPL-3.0
engeldlgado/toshllm
TOSHLLM: RUN LLM ON MAC
TOSHLLM — a native macOS app in Swift that runs large language models locally on Intel‑Mac with AMD GPU, using Metal acceleration. Supports llama.cpp and is compatible with Hackintosh configurations.
// KEY FEATURES
- Runs LLMs locally on Intel‑Mac with AMD GPU via Metal acceleration.
- Native macOS app written in Swift, ensures smooth operation with Metal.
- Supports llama.cpp models in GGUF format for fast loading and inference.
- Works on Hackintosh and Intel‑Mac without extra drivers, includes GUI.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram