R_REDDYX.XYZ
AIRust★ 742⑂ 121 forksApache-2.0

pegainfer-project/pegainfer

PEGAINFER: Rust + CUDA Infer

Pure Rust LLM engine with CUDA acceleration, OpenAI API compatible, runs Qwen3 and Kimi‑K2 without PyTorch.

// KEY FEATURES

  • Pure Rust + CUDA: maximum performance
  • OpenAI‑compatible API, no PyTorch dependencies
  • Qwen3 and Kimi‑K2 model support out‑of‑the‑box
#cuda#cuda-kernels#deepseek#gpu#inference#inference-engine#kimi#kimi-k2#kv-cache#llm#llm-inference#llm-serving
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

CUGA-AGENT — Universal Agent★ 742AI REVERSE ENGINEERING: CASES AND ALTERNATIVES★ 742Claude Auto-Resume★ 741NEXTCRM: OPEN CRM ON NEXT.JS★ 743PROBE - FAST AI CODE SEARCH★ 741MLX-DSPARK: 4X LLM ACCELERATION★ 740

← FULL CATALOG

pegainfer-project/pegainfer — PEGAINFER: Rust + CUDA Infer