AIPython★ 474⑂ 396 forksMIT
runpod-workers/worker-vllm
WORKER-VLLM: POWERFUL LLM DEPLOYMENT
Runpod worker template for deploying LLM via vLLM — quick start and scalable operation.
// KEY FEATURES
- vLLM support for high throughput
- Ready-made template for Runpod-workers
- Minimal setup and fast deployment
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram