R_REDDYX.XYZ
AIShell★ 3,247

llm-d/llm-d

LLM inference acceleration on Kubernetes

Achieve state of the art inference performance with modern accelerators on Kubernetes

// KEY FEATURES

  • Optimized for GPU and TPU in K8s
  • Automatic scaling of inference workloads
  • Minimalist shell interface without dependencies
#ai#cncf#distributed-inference#gpu#inference#intelligent-routing#kubernetes#llm#model-server
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

OPEN identifiableICO - AI ON DESKTOP★ 3247EDGEVER — AI-ALTERNATIVE TO EVERNOTE★ 3247Chat Interface for AI Agents★ 3253PENGUIN-HARNESS - DESKTOP AGENT FACTORY★ 3240PRD and Tech Design Templates★ 3257GRAPHJIN - UNIFIED AI GRAPH★ 3236

← FULL CATALOG

llm-d/llm-d — LLM inference acceleration on Kubernetes