AIPython★ 79,783
vllm-project/vllm
High-performance LLM engine
A high-performance and memory-efficient engine for inference and serving large language models.
// KEY FEATURES
- High throughput
- Low memory usage
- Support for distributed serving
#amd#blackwell#cuda#deepseek#deepseek-v3#gpt#gpt-oss#inference#kimi#llama#llm#llm-serving
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram