AIGo★ 1,747⑂ 300 forksApache-2.0
NVIDIA/Personal-AI-Router
Home AI Inference Router
Routes AI inference requests across home devices like GPUs, NPUs, and CPUs for optimal local performance.
// KEY FEATURES
- Distributes LLM inference across multiple local devices (GPU, CPU, NPU)
- Automatically selects best device per request based on model and hardware
- Provides OpenAI-compatible API for seamless local AI integration
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram