AIPython★ 1,585⑂ 16 forksApache-2.0
RunanywhereAI/trnrt
LLM Inference on AWS Trainium
Open-source LLM inference engine for AWS Trainium featuring NKI megakernels, 1M-token context, and OpenAI-compatible API.
// KEY FEATURES
- Runs LLM inference on AWS Trainium via NKI megakernels
- Supports 1M-token context window for long sequences
- Provides OpenAI-compatible API for easy integration
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram