R_REDDYX.XYZ
AIPython★ 474⑂ 396 forksMIT

runpod-workers/worker-vllm

WORKER-VLLM: POWERFUL LLM DEPLOYMENT

Runpod worker template for deploying LLM via vLLM — quick start and scalable operation.

// KEY FEATURES

  • vLLM support for high throughput
  • Ready-made template for Runpod-workers
  • Minimal setup and fast deployment
#language-model#llm#runpod#vllm
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

AI-COLLAB-PLAYBOOK - Practical Guide★ 474MASTERING LANGGRAPH 1.0★ 474Acoustic Drone Detector★ 474MAIN AI-ASSISTANT FOR CODE★ 474Event-Sourced Actor Framework★ 474ROAM-CODE - AI AGENT FOR CODE★ 473

← FULL CATALOG

runpod-workers/worker-vllm — Worker-Vllm: Powerful LLM…