AIGo★ 38
hadihonarvar/flock
Self-hosted LLM gateway
A single Go binary turns your Mac and Linux machines into a private inference cluster featuring multi‑machine routing, sharding via llama.cpp‑RPC, and support for the OpenAI and Anthropic APIs.
// KEY FEATURES
- Multi‑machine routing and sharding via llama.cpp‑RPC
- Per‑user API keys, quotas, and usage auditing
- Unified endpoint compatible with OpenAI and Anthropic APIs
- Single Go binary, quick installation on macOS and Linux
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram