AIPython★ 319
DocAILab/XRAG
XRAG: EVALUATION OF RAG MODULES
XRAG evaluates core components of RAG systems: indexing, retrieval, and generation. Using standard datasets it compares different module implementations, revealing their strengths and weaknesses.
// KEY FEATURES
- Measures latency and throughput of document indexing in various formats.
- Compares search accuracy (recall, MRR) for vector and hybrid retrievers.
- Evaluates answer generation quality using faithfulness and answer relevance metrics.
- Provides scripts for experiments with LlamaIndex and LLMs (GPT‑4, Claude, Llama).
#evaluation#llamaindex#llm#rag
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram