R_REDDYX.XYZ
AIRust★ 299⑂ 23 forksMIT

llamastash/llamastash

LLAMASTASH TERMINAL LLM MANAGER

llamastash — terminal-native manager for local LLMs with zero overhead. Launches, supervises, and routes GGUF models via a single OpenAI‑compatible endpoint.

// KEY FEATURES

  • Launches any GGUF model with a single click from the terminal.
  • Automatically monitors process health and restarts on failure.
  • Routes requests to the selected model via a single OpenAI‑compatible API.
  • Supports hot‑swap of models without server restart, zero‑overhead.
#ai#gguf#llamacpp#llm#lmstudio#local-ai#ollama
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

ID-LoRA: AI Video★ 299FonaTech Chronos★ 299Skill Generator for AI★ 299OPEN SOURCE AI AGENT FOR CODE★ 299PLUGINS LIBRARY OPENAI CODEX★ 300HIVEMIND – UNIFIED BRAIN FOR AGENTS★ 298

← FULL CATALOG

llamastash/llamastash — Llamastash Terminal LLM Manager