AIPython★ 334⑂ 45 forks
ekzhang/openjev-sglang
OPEJEV-SGLANG API FOR LLM
openjev-sglang provides a Jev-compatible API endpoint that works exclusively with prefill of open models. It supports structured generation and integration with SystemOne. The Python project has already gathered 321 stars on GitHub.
// KEY FEATURES
- Accepts Jev requests and returns prefill responses from open LLMs.
- Generates structured output according to the Jev schema.
- Integrates with SystemOne via a simple HTTP/JSON API.
- Implemented in Python, easy to deploy and requires minimal dependencies.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram