R_REDDYX.XYZ
AIPython★ 360⑂ 14 forks

xiaol/wkvm

Hybrid LLM Inference

Library for performing inference of hybrid language models, including Gemma, RWKV, and their combinations, supporting efficient execution on CPU and GPU.

// KEY FEATURES

  • Inference of Gemma and RWKV models through a unified API interface.
  • Support for hybrid architectures, e.g., Gemma‑RWKV mixtures and other combinations.
  • Optimized KV‑states cache accelerates generation of long sequences.
  • Compatible with HuggingFace Transformers and PyTorch for easy integration.
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

AI AGENT CAMP — NON-DEV COURSE★ 360OPENCLAW.NET: Self-hosted .NET Gateway★ 360CCPROXY Mods for Claude Code★ 360OPEN MANAGED AGENTS: OPEN API★ 360SPRING BOOT SKILLS: AI AGENT★ 360FAST DATA ANALYSIS IN TYPESCRIPT★ 360

← FULL CATALOG

xiaol/wkvm — Hybrid LLM Inference | REDDYX AI