AIRust★ 299⑂ 23 forksMIT
llamastash/llamastash
LLAMASTASH TERMINAL LLM MANAGER
llamastash — terminal-native manager for local LLMs with zero overhead. Launches, supervises, and routes GGUF models via a single OpenAI‑compatible endpoint.
// KEY FEATURES
- Launches any GGUF model with a single click from the terminal.
- Automatically monitors process health and restarts on failure.
- Routes requests to the selected model via a single OpenAI‑compatible API.
- Supports hot‑swap of models without server restart, zero‑overhead.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram