AITypeScript★ 53
LiteLLM-Labs/litellm-rust
Minimal LiteLLM Gateway on Rust
A lightweight Rust gateway compatible with LiteLLM, designed for integration with coding agents. It provides fast access to LLMs via a standard API.
// KEY FEATURES
- Supports all main LiteLLM endpoints (chat, completions, embeddings)
- Real-time streaming of responses for interactive agents
- Minimal dependencies and low memory usage thanks to Rust
- Easy deployment via Docker or as a standalone binary
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram