R_REDDYX.XYZ
AIRust★ 2,986⑂ 222 forksMIT

michaelfeil/infinity

FAST EMBEDDING SERVING ENGINE IN RUST

Infinity is a high-performance engine for text embeddings, reranking, CLIP, CLAP, and ColPali. Written in Rust for low latency and high throughput. 2963 stars on GitHub.

// KEY FEATURES

  • Serves text-embeddings, reranking, CLIP, CLAP, ColPali via single API
  • Written in Rust for minimal latency and maximum throughput
  • Supports BERT models and LLM ecosystem for RAG pipelines
  • Production-ready: batching, caching, horizontal scaling
#bert-embeddings#llm#text-embeddings
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

VEKSA: AI Meeting Transcription★ 2984GRAPH RAG KNOWLEDGE BASE ON TIDB★ 2982Native Switch Games on Apple★ 2981LANGGRAPHJS TURNS AGENTS INTO GRAPHS★ 2980READANY - AI Book Reader★ 2978AI Token Tracking★ 2995

← FULL CATALOG

michaelfeil/infinity — Fast Embedding Serving Engine IN Rust