AIRust★ 5,122⑂ 458 forksApache-2.0
huggingface/text-embeddings-inference
TEXT-EMBEDDINGS-INFERENCE - Instant Embedding Inference
Fast inference for text embedding models in Rust, providing low latency and high throughput.
// KEY FEATURES
- Support for popular models (BERT, Sentence‑Transformer)
- Async API with gRPC and HTTP endpoints
- Minimal dependencies, pure Rust without GC
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram