Data: open-source projects on GitHub
17 repositories on Data, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
LlamaIndex Data Indexing
A platform for ingesting, indexing, and querying data with support for LLM agents and OCR.
★ 49,363 · PythonAdaptive web scraper
An adaptive framework for web scraping that supports both single requests and large-scale crawlers.
★ 49,091 · PythonAKSHARE — FINANCIAL DATA ON PYTHON
Library for financial data: stocks, bonds, currencies, futures. 23k stars on GitHub. Simple API without extra dependencies.
★ 23,341 · PythonDATA-JUICER: DATA FOR FOUNDATION MODELS
A data processing tool for working with foundation models in Python. Over 6500 stars on GitHub!
★ 6,500 · PythonEDIT-BANANA: STATISTICS NOW EDITABLE
Framework for converting statistical formats into editable ones. 5300 stars on GitHub!
★ 5,300 · PythonLAZYLLM - THE LAZIEST WAY
LazyLLM lets you quickly create multi-agent LLM applications with minimal code and maximum simplicity.
★ 3,833 · PythonDocetl: Agent LLM ETL
Docetl is a system for agentic LLM data processing and ETL, enabling automation of complex pipelines using AI agents.
★ 3,765 · PythonANY SITE TO LLM DATA
AnyCrawl — a Node.js crawler that turns websites into LLM‑ready data and extracts structured search results from Google, Bing, Baidu, and others.
★ 3,547 · MDXQUANT-MIND: Smart Data Extraction
QuantMind is a framework for intelligent data extraction and knowledge discovery in quantitative financial analytics using Python.
★ 3,136 · PythonCURATOR: LLM DATA PREPARATION
Curator is a toolkit for preprocessing and curating data, accelerating LLM training.
★ 1,860 · PythonLotus: Accelerating AI Processing
Optimized LLM data processing up to 1000× faster, with simple Pandas syntax. 1.6k ★, Python.
★ 1,604 · PythonDATA PREP KIT: ACCELERATE AI GENERATION
Open-source toolkit for preparing data to train and use GenAI models. Simplifies cleaning, transformation, and labeling of datasets.
★ 969 · HTMLRust + LLM: Indexing Speed
Swiftide — fast streaming indexing and queries for AI agents on Rust. 710⭐ and growing.
★ 806 · RustFree Social Science Datasets
A curated collection of over 100 free datasets covering social science, applied microeconomics, and data visualization topics.
★ 513AI FOR BUSINESS DECISIONS
AI agent and data analytics platform for corporations. Helps make business decisions based on AI.
★ 470 · TypeScriptDATAMIND SMART ASSISTANT FOR DATA
DataMind — AI assistant on LlamaIndex with RAG, GraphRAG, NL2SQL, skills and memory. Supports multimodal input and working with data of any type.
★ 456 · PythonLIONAGI - AI Orchestra for Code
lionagi is a Python-based AI agent orchestra that unites LLMs, tools, and data to build complex workflows.
★ 412 · PythonNew projects on this topic in Telegram
Telegram →