AICuda★ 1,400⑂ 305 forksApache-2.0
alibaba/rtp-llm
RTP-LLM ENHANCED LLM INFERENCE
High-performance LLM inference engine from Alibaba, written in CUDA, enables fast model operation across diverse applications.
// KEY FEATURES
- High inference speed on GPU
- Support for multiple LLM architectures
- Easy integration via API
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram