R_REDDYX.XYZ
AIRust★ 1,693⑂ 98 forksApache-2.0

intentee/paddler

PADDLER - Simple LLM Load Balancer

Open load balancer and platform for LLM/VLM service on Rust, running on CPU and GPU with minimal dependencies.

// KEY FEATURES

  • CPU and GPU support without complex configuration
  • Simple deployment around the ggml ecosystem
  • Alternative to llm-d and Docker Model Runner with fewer parts
#ai#llamacpp#llm#llmops#load-balancer
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

img2obj: Codex plugin★ 1693TERRVISION: CLOUD DIAGRAMS FROM CODE★ 1691MAILCHEAP AFFORDABLE NEWSLETTER FOR AGENTS★ 1690Claude Code Tricks Collection★ 1698Papermorph Book-to-Web Animator★ 1687TOOLKIT FOR CLINICAL AI★ 1699

← FULL CATALOG

intentee/paddler — PADDLER - Simple LLM Load Balancer