R_REDDYX.XYZ
AIPython★ 79,783

vllm-project/vllm

High-performance LLM engine

A high-performance and memory-efficient engine for inference and serving large language models.

// KEY FEATURES

  • High throughput
  • Low memory usage
  • Support for distributed serving
#amd#blackwell#cuda#deepseek#deepseek-v3#gpt#gpt-oss#inference#kimi#llama#llm#llm-serving
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

LLM Input Compression★ 79744LLM Course with Practice★ 79245OPEN AGENTIC VIDEO PRODUCTION★ 80474RAGFlow — RAG Engine with Agents★ 80605AI Full-Stack Observer★ 78779Design Systems in Markdown★ 78509

← FULL CATALOG

vllm-project/vllm — High-performance LLM engine | REDDYX AI