AIRust★ 742⑂ 121 forksApache-2.0
pegainfer-project/pegainfer
PEGAINFER: Rust + CUDA Infer
Pure Rust LLM engine with CUDA acceleration, OpenAI API compatible, runs Qwen3 and Kimi‑K2 without PyTorch.
// KEY FEATURES
- Pure Rust + CUDA: maximum performance
- OpenAI‑compatible API, no PyTorch dependencies
- Qwen3 and Kimi‑K2 model support out‑of‑the‑box
#cuda#cuda-kernels#deepseek#gpu#inference#inference-engine#kimi#kimi-k2#kv-cache#llm#llm-inference#llm-serving
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram