AIRust★ 233⑂ 33 forksApache-2.0
traceloop/hub
HUB: RUST LLM GATEWAY
High-scale LLM gateway in Rust with built-in observability via OpenTelemetry. Easily scalable and production-ready.
// KEY FEATURES
- High throughput and low latency
- Full OpenTelemetry integration for metrics and tracing
- Written in safe and fast Rust
#artificial-intelligence#datascience#generative-ai#llm#llmops#ml#model-monitoring#observability#open-source#opentelemetry#rust
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram