AIGo★ 284⑂ 18 forksMIT
raketenkater/ggrun
Not a Llama, no stance
Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.
// KEY FEATURES
- Multi-GPU tensor-split for distribution across cards
- AI Tune — automatic flag selection for your hardware
- Auto-resizer after crashes and HuggingFace integration
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram