AIRust★ 1,464⑂ 92 forksApache-2.0
ollaya-dev/ollaya
Local Decision Model Server
Serves Laya, decider, NLI, and GLiClass models via a TypeSafe‑compatible API for local inference.
// KEY FEATURES
- Downloads and caches Laya, decider, NLI, GLiClass models automatically on start.
- Exposes a TypeSafe‑compatible REST/JSON API for model inference calls.
- Built in Rust for low latency, safe concurrent serving of multiple models.
#calibration#classification#decision-models#gliclass#jev#laya#llm-routing#local-inference#nli#ollama#onnx#onnxruntime
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram