AIRust★ 2,986⑂ 222 forksMIT
michaelfeil/infinity
FAST EMBEDDING SERVING ENGINE IN RUST
Infinity is a high-performance engine for text embeddings, reranking, CLIP, CLAP, and ColPali. Written in Rust for low latency and high throughput. 2963 stars on GitHub.
// KEY FEATURES
- Serves text-embeddings, reranking, CLIP, CLAP, ColPali via single API
- Written in Rust for minimal latency and maximum throughput
- Supports BERT models and LLM ecosystem for RAG pipelines
- Production-ready: batching, caching, horizontal scaling
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram