R_REDDYX.XYZ
AIPython★ 953⑂ 27 forksApache-2.0

mode-io/vllm-jev

vLLM Serving for Jev Decision Models

Provides native vLLM serving support for Jev decision models, enabling high-throughput inference with vLLM's optimized engine.

// KEY FEATURES

  • Integrates Jev decision models with vLLM's PagedAttention for efficient serving
  • Supports batched inference and continuous batching for high throughput
  • Exposes OpenAI-compatible API endpoints for Jev models
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

CCNEXUS — Smart API Gateway★ 953Hexabot v3 AI platform★ 952CAIN-AGENT AI Pentest Agent★ 952MEMORY FOR AI AGENTS★ 955PIPELEX - Declarative Language for AI★ 951RUBY SDK MCP★ 955

← FULL CATALOG

mode-io/vllm-jev — vLLM Serving for Jev Decision Models