R_REDDYX.XYZ
AIGo★ 284⑂ 18 forksMIT

raketenkater/ggrun

Not a Llama, no stance

Auto-tuned launcher for GGUF models on llama.cpp — server with multi‑GPU support, hardware‑specific tuning, and crash recovery. Stars: 226.

// KEY FEATURES

  • Multi-GPU tensor-split for distribution across cards
  • AI Tune — automatic flag selection for your hardware
  • Auto-resizer after crashes and HuggingFace integration
#cuda#gguf#golang#inference-server#llama-cpp#llamacpp#llm#local-llm#localllama#metal#moe#multi-gpu
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

CAPA: AI Agent in 5 min★ 284DATASETS FOR AI IN HOME ASSISTANT★ 284Kairon AI Platform★ 284MCP SERVER FOR MONGODB★ 284OPEN CONSTRUCTION COST DATABASE★ 284SICO — NEXT-GENERATION DIGITAL WORKER★ 284

← FULL CATALOG

raketenkater/ggrun — Not a Llama, no stance | REDDYX AI