R_REDDYX.XYZ
AIGo★ 38

hadihonarvar/flock

Self-hosted LLM gateway

A single Go binary turns your Mac and Linux machines into a private inference cluster featuring multi‑machine routing, sharding via llama.cpp‑RPC, and support for the OpenAI and Anthropic APIs.

// KEY FEATURES

  • Multi‑machine routing and sharding via llama.cpp‑RPC
  • Per‑user API keys, quotas, and usage auditing
  • Unified endpoint compatible with OpenAI and Anthropic APIs
  • Single Go binary, quick installation on macOS and Linux
#ai-gateway#aider#anthropic#claude-code#cursor#gguf#golang#inference#llama-cpp#llm#local-llm#mlx
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Llama2 Assembly★ 38Personal AI agent with memory★ 38vLLM for RTX 2080Ti★ 38Inference Agent Tokenmaxxing★ 38Dual-Clock Euler Sampler★ 38Persistent Agent Memory Store★ 38

← FULL CATALOG

hadihonarvar/flock — Self-hosted LLM gateway | REDDYX AI