R_REDDYX.XYZ

Information Retrieval: open-source projects on GitHub

34 repositories on Information Retrieval, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

RAG 533LLM 2094Retrieval Augmented Generation 85NLP 84Semantic Search 101AI Agents 1319Retrieval 25Vector Search 69Machine Learning 190Search 47Generative AI 192Agents 400Agent 547Chatgpt 314
VectifyAI/PageIndex

Vectorless RAG Index

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

★ 32,176 · Python
onyx-dot-app/onyx

Onyx AI platform

An open AI platform with advanced features and support for any LLM.

★ 29,436 · Python
deepset-ai/haystack

Haystack: AI Framework for LLM

An open framework for building production-ready LLM applications with modular control over search, routing, memory, and generation.

★ 25,289 · MDX
arc53/DocsGPT

DocsGPT: Private AI Assistant

Private AI platform for agents, assistants, and enterprise search with support for multiple models.

★ 17,882 · Python
Unstructured-IO/unstructured

Document Structuring

An open ETL solution for converting complex documents into clean structured data formats for language models.

★ 14,764 · HTML
neuml/txtai

TXTAI — AI All-in-One

An algorithmic framework for semantic search, LLM orchestration, and language-model workflows. All in one!

★ 12,620 · Python
FlagOpen/FlagEmbedding

FLAGEMBEDDING: SMART SEARCH

Project for efficient retrieval and retrieval-augmented generation on Python. Supports fast search and integration with LLM.

★ 12,323 · Python
airweave-ai/airweave

AIRWEAVE: AI AGENTS GITHUB CONTEXT

Open context extraction layer for AI agents. Python tool with 6K+ stars!

★ 6,379 · Python
SylphAI-Inc/AdalFlow

AdalFlow - Boost LLM Efficiency

A library for building and auto-optimizing LLM-based applications in Python. Simplifies working with prompts and model configuration.

★ 4,153 · Python
langroid/langroid

LANGRID - Multi-agent AI for Code

A simple framework for building LLM-based agents with memory and tool support.

★ 4,029 · Python
embeddings-benchmark/mteb

MTEB - Benchmark for Text Embeddings

Large-scale benchmark for evaluating the quality of text embeddings. 800+ tasks across 50+ languages.

★ 3,287 · Python
superlinked/sie

SUPERLINKED INFERENCE ENGINE

Open-source server for embedding inference, reranking, and data extraction. 2000+ stars on GitHub.

★ 2,029 · Python
xhluca/bm25s

BM25S: FAST SEARCH IN PYTHON

Fast BM25 algorithm on NumPy and Numba for efficient text search.

★ 1,824 · Python
onestardao/WFGY

WFGY 5.0 POLARIS PROTOCOL

WFGY 5.0 — major open-source release for AI reasoning, RAG, agents and real-world workflows. 1752 ⭐

★ 1,752 · Jupyter Notebook
felladrin/awesome-ai-web-search

Awesome AI Web Search

A collection of the best web tools where AI helps search the web faster and more accurately.

★ 1,519 · HTML
StarlightSearch/EmbedAnything

EMBEDANYTHING - POWERFUL INFERENCE ON RUST

EmbedAnything is a high‑performance, modular, and memory‑safe framework for inference, ingestion, and indexing on Rust.

★ 1,324 · Rust
NVIDIA/raft

RAFT - Accelerate ML on CUDA

The RAFT library provides CUDA‑accelerated ML and IR algorithms, simplifying the creation of high‑performance applications.

★ 1,054 · Cuda
Raudaschl/rag-fusion

RAG-FUSION: IMPROVEMENT OF RETRIEVAL

RAG-Fusion generates multiple queries and combines their results via Reciprocal Rank Fusion, improving search quality for RAG systems. The package includes evaluation on

★ 961 · Python
superwesleyhys-ux/factcircuit

FactCircuit Fact-Check Platform

FactCircuit is an auditable loop for checking claims and evidence with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.

★ 927 · Python
lightonai/pylate

PYLATE SPEEDS UP SEARCH

Library for training late-interaction models and efficient search over large text collections.

★ 910 · Python
NVIDIA/cuvs

CUVS - Accelerated Vector Search

cuvs is a library for fast vector search and clustering on GPU, using CUDA for maximum performance.

★ 897 · Cuda
EverMind-AI/SkillCorpus

Skill corpus for agents

The project collects SKILL.md files into a single searchable skill catalog for AI agents, enabling fast search and automatic task-matching evaluation.

★ 703 · Python
xynehq/xyne

XYNE: AI SEARCH FOR WORK

Xyne — open-source AI search & answer engine for work, alternative to Glean. Written in TypeScript, it uses Bun, Claude and AWS Bedrock for fast indexing and answer gener

★ 698 · TypeScript
DataScienceUIBK/Rankify

RANKIFY: TOOL FOR RAG

Rankify — Python toolkit for search, reranking, and RAG. Includes 40 benchmark datasets, 7+ search methods and 24+ ranking models. Supports multiple RAG schemes and easy

★ 683 · Python
aryn-ai/sycamore

SYCAMORE: AI DATA SEARCH

Sycamore — an LLM-based platform for searching and analyzing unstructured data. Allows quick extraction of insights from texts, documents, and logs.

★ 606 · Python
relari-ai/continuous-eval

CONTINUOUS-EVAL - LLM EVALUATION ON DATA

Platform for automatic evaluation of LLM applications based on real data. Enables measuring quality and improving models without manual effort.

★ 519 · Python
ekimetrics/adaptive-chunking

ADAPTIVE CHUNKING FOR RAG

Automatically selects the optimal chunking method for each document to improve RAG pipelines. Accepted at LREC 2026.

★ 404 · Python
antflydb/antfly

ANTFLY - POWERFUL TOOL ON ZIG

antfly is a Zig project with 376 stars on GitHub. A fast and efficient tool for developers.

★ 376 · Zig
bibinprathap/VeritasGraph

VeritasGraph Open Knowledge Graph

Open-source framework for Knowledge Graph and GraphRAG in Python for multi-hop reasoning and verifiable data attribution.

★ 327 · Python
microsoft/rag-experiment-accelerator

RAG EXPERIMENT ACCELERATOR

Tool for rapid RAG experiments with Azure Cognitive Search. Automates chunking, embeddings, and answer quality evaluation.

★ 319 · Python
iamarunbrahma/pdf-to-markdown

PDF TO MARKDOWN WITHOUT EXTRA

The pdf-to-markdown project converts PDF files into clean Markdown, preserving headings, lists, tables and images. It works as a CLI utility and as an importable Python m

★ 216 · Python
salikhussain71-code/PAKGOV-RAG-project

Bilingual Urdu-English Legal RAG

RAG system for Pakistani government and legal documents with Urdu-English OCR, hybrid retrieval, and citation grounding.

★ 130 · Python
volcengine/SearchCLI

AI Search in CLI

Open-source CLI tool for integrating AI search, recommendations, and conversational search into agent and business systems.

★ 94 · TypeScript
statespace-tech/statespace

STATESSPACE - AGENTIC WEB SEARCH

The statespace project is a web search agent built in Rust that helps find and utilize agentic capabilities on the web.

★ 1 · Rust

New projects on this topic in Telegram

Telegram →
Information Retrieval — 34 open-source GitHub projects | REDDYX AI