R_REDDYX.XYZ
AITypeScript★ 53

LiteLLM-Labs/litellm-rust

Minimal LiteLLM Gateway on Rust

A lightweight Rust gateway compatible with LiteLLM, designed for integration with coding agents. It provides fast access to LLMs via a standard API.

// KEY FEATURES

  • Supports all main LiteLLM endpoints (chat, completions, embeddings)
  • Real-time streaming of responses for interactive agents
  • Minimal dependencies and low memory usage thanks to Rust
  • Easy deployment via Docker or as a standalone binary
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Chat templates for LLM★ 53LLM course from scratch★ 53AI Workspace with SuperCompress★ 53Speculative Decoding Training Framework★ 53Knowledge for AI Systems★ 52Image AI Generator 2026★ 52

← FULL CATALOG

LiteLLM-Labs/litellm-rust — Minimal LiteLLM Gateway on Rust