R_REDDYX.XYZ
AIGo★ 1,747⑂ 300 forksApache-2.0

NVIDIA/Personal-AI-Router

Home AI Inference Router

Routes AI inference requests across home devices like GPUs, NPUs, and CPUs for optimal local performance.

// KEY FEATURES

  • Distributes LLM inference across multiple local devices (GPU, CPU, NPU)
  • Automatically selects best device per request based on model and hardware
  • Provides OpenAI-compatible API for seamless local AI integration
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Multi-agent orchestrator for Codex★ 1749STARTLUX‑DECISION: AI DECISIONS★ 1745Illustrations for Text★ 1750ERD EDITOR FOR DB SCHEMES★ 1750FIGMA‑CONSOLE MCP – DESIGN SYSTEM API★ 1751Parlor AI on device★ 1752

← FULL CATALOG

NVIDIA/Personal-AI-Router — Home AI Inference Router