AIRust★ 1,693⑂ 98 forksApache-2.0
intentee/paddler
PADDLER - Simple LLM Load Balancer
Open load balancer and platform for LLM/VLM service on Rust, running on CPU and GPU with minimal dependencies.
// KEY FEATURES
- CPU and GPU support without complex configuration
- Simple deployment around the ggml ecosystem
- Alternative to llm-d and Docker Model Runner with fewer parts
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram