R_REDDYX.XYZ
AICuda★ 1,400⑂ 305 forksApache-2.0

alibaba/rtp-llm

RTP-LLM ENHANCED LLM INFERENCE

High-performance LLM inference engine from Alibaba, written in CUDA, enables fast model operation across diverse applications.

// KEY FEATURES

  • High inference speed on GPU
  • Support for multiple LLM architectures
  • Easy integration via API
#gpt#inference#llama#llm#llm-serving#llmops#model-serving
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

aws-genai-llm-chatbot - POWERFUL CHATBOT ON AWS★ 1399OPEN DESKTOP-PET WITH AI★ 1401LLM IN SPACY PIPELINE PAINLESSLY★ 1399NullMotion: ad preview★ 1398GENERATIVE AI FOR BUSINESS★ 1403AI Video Production Kit★ 1397

← FULL CATALOG

alibaba/rtp-llm — Rtp-LLM Enhanced LLM Inference | REDDYX AI