R_REDDYX.XYZ
AIPython★ 108⑂ 17 forksApache-2.0

openJiuwen-ai/agent-infer

Agentic Inference Framework

openJiuwen-ai/agent-infer is a vLLM-based framework for efficient execution of agentic workloads. It simplifies deployment and scaling of LLM inference in multi-agent scenarios.

// KEY FEATURES

  • Fast LLM inference through an optimized vLLM backend with batch processing support.
  • Support for dynamic agent orchestration with shared KV cache usage.
  • Streaming token generation with low latency and flexible parameter configuration.
  • Easy integration with popular agent frameworks (LangChain, AutoGPT, BabyAGI).
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Open Turkish TTS Suite★ 108SheetasToken — Table Data Analysis★ 107Claude Code Backdoor★ 109LLM TCO Calculator★ 109AI Trip Planner★ 107AI Content Generator★ 110

← FULL CATALOG

openJiuwen-ai/agent-infer — Agentic Inference Framework