Information Retrieval: open-source projects on GitHub
34 repositories on Information Retrieval, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
Vectorless RAG Index
📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
★ 32,176 · PythonOnyx AI platform
An open AI platform with advanced features and support for any LLM.
★ 29,436 · PythonHaystack: AI Framework for LLM
An open framework for building production-ready LLM applications with modular control over search, routing, memory, and generation.
★ 25,289 · MDXDocsGPT: Private AI Assistant
Private AI platform for agents, assistants, and enterprise search with support for multiple models.
★ 17,882 · PythonDocument Structuring
An open ETL solution for converting complex documents into clean structured data formats for language models.
★ 14,764 · HTMLTXTAI — AI All-in-One
An algorithmic framework for semantic search, LLM orchestration, and language-model workflows. All in one!
★ 12,620 · PythonFLAGEMBEDDING: SMART SEARCH
Project for efficient retrieval and retrieval-augmented generation on Python. Supports fast search and integration with LLM.
★ 12,323 · PythonAIRWEAVE: AI AGENTS GITHUB CONTEXT
Open context extraction layer for AI agents. Python tool with 6K+ stars!
★ 6,379 · PythonAdalFlow - Boost LLM Efficiency
A library for building and auto-optimizing LLM-based applications in Python. Simplifies working with prompts and model configuration.
★ 4,153 · PythonLANGRID - Multi-agent AI for Code
A simple framework for building LLM-based agents with memory and tool support.
★ 4,029 · PythonMTEB - Benchmark for Text Embeddings
Large-scale benchmark for evaluating the quality of text embeddings. 800+ tasks across 50+ languages.
★ 3,287 · PythonSUPERLINKED INFERENCE ENGINE
Open-source server for embedding inference, reranking, and data extraction. 2000+ stars on GitHub.
★ 2,029 · PythonBM25S: FAST SEARCH IN PYTHON
Fast BM25 algorithm on NumPy and Numba for efficient text search.
★ 1,824 · PythonWFGY 5.0 POLARIS PROTOCOL
WFGY 5.0 — major open-source release for AI reasoning, RAG, agents and real-world workflows. 1752 ⭐
★ 1,752 · Jupyter NotebookAwesome AI Web Search
A collection of the best web tools where AI helps search the web faster and more accurately.
★ 1,519 · HTMLEMBEDANYTHING - POWERFUL INFERENCE ON RUST
EmbedAnything is a high‑performance, modular, and memory‑safe framework for inference, ingestion, and indexing on Rust.
★ 1,324 · RustRAFT - Accelerate ML on CUDA
The RAFT library provides CUDA‑accelerated ML and IR algorithms, simplifying the creation of high‑performance applications.
★ 1,054 · CudaRAG-FUSION: IMPROVEMENT OF RETRIEVAL
RAG-Fusion generates multiple queries and combines their results via Reciprocal Rank Fusion, improving search quality for RAG systems. The package includes evaluation on
★ 961 · PythonFactCircuit Fact-Check Platform
FactCircuit is an auditable loop for checking claims and evidence with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.
★ 927 · PythonPYLATE SPEEDS UP SEARCH
Library for training late-interaction models and efficient search over large text collections.
★ 910 · PythonCUVS - Accelerated Vector Search
cuvs is a library for fast vector search and clustering on GPU, using CUDA for maximum performance.
★ 897 · CudaSkill corpus for agents
The project collects SKILL.md files into a single searchable skill catalog for AI agents, enabling fast search and automatic task-matching evaluation.
★ 703 · PythonXYNE: AI SEARCH FOR WORK
Xyne — open-source AI search & answer engine for work, alternative to Glean. Written in TypeScript, it uses Bun, Claude and AWS Bedrock for fast indexing and answer gener
★ 698 · TypeScriptRANKIFY: TOOL FOR RAG
Rankify — Python toolkit for search, reranking, and RAG. Includes 40 benchmark datasets, 7+ search methods and 24+ ranking models. Supports multiple RAG schemes and easy
★ 683 · PythonSYCAMORE: AI DATA SEARCH
Sycamore — an LLM-based platform for searching and analyzing unstructured data. Allows quick extraction of insights from texts, documents, and logs.
★ 606 · PythonCONTINUOUS-EVAL - LLM EVALUATION ON DATA
Platform for automatic evaluation of LLM applications based on real data. Enables measuring quality and improving models without manual effort.
★ 519 · PythonADAPTIVE CHUNKING FOR RAG
Automatically selects the optimal chunking method for each document to improve RAG pipelines. Accepted at LREC 2026.
★ 404 · PythonANTFLY - POWERFUL TOOL ON ZIG
antfly is a Zig project with 376 stars on GitHub. A fast and efficient tool for developers.
★ 376 · ZigVeritasGraph Open Knowledge Graph
Open-source framework for Knowledge Graph and GraphRAG in Python for multi-hop reasoning and verifiable data attribution.
★ 327 · PythonRAG EXPERIMENT ACCELERATOR
Tool for rapid RAG experiments with Azure Cognitive Search. Automates chunking, embeddings, and answer quality evaluation.
★ 319 · PythonPDF TO MARKDOWN WITHOUT EXTRA
The pdf-to-markdown project converts PDF files into clean Markdown, preserving headings, lists, tables and images. It works as a CLI utility and as an importable Python m
★ 216 · PythonBilingual Urdu-English Legal RAG
RAG system for Pakistani government and legal documents with Urdu-English OCR, hybrid retrieval, and citation grounding.
★ 130 · PythonAI Search in CLI
Open-source CLI tool for integrating AI search, recommendations, and conversational search into agent and business systems.
★ 94 · TypeScriptSTATESSPACE - AGENTIC WEB SEARCH
The statespace project is a web search agent built in Rust that helps find and utilize agentic capabilities on the web.
★ 1 · RustNew projects on this topic in Telegram
Telegram →