R_REDDYX.XYZ
AIRust★ 1,464⑂ 92 forksApache-2.0

ollaya-dev/ollaya

Local Decision Model Server

Serves Laya, decider, NLI, and GLiClass models via a TypeSafe‑compatible API for local inference.

// KEY FEATURES

  • Downloads and caches Laya, decider, NLI, GLiClass models automatically on start.
  • Exposes a TypeSafe‑compatible REST/JSON API for model inference calls.
  • Built in Rust for low latency, safe concurrent serving of multiple models.
#calibration#classification#decision-models#gliclass#jev#laya#llm-routing#local-inference#nli#ollama#onnx#onnxruntime
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

FAST LLM ON AMD★ 1464WordPress AI Assistant★ 1465MINUET AI.NVIM — SMART AUTOCOMPLETION★ 1462KONNECT: AI PCB Design★ 1462AWESOME MUSE CONNECTORS★ 1462YOUR PERSONAL AI AGENT IN CLOUDFLARE!!!!!★ 1468

← FULL CATALOG

ollaya-dev/ollaya — Local Decision Model Server | REDDYX AI