Data Extraction: open-source projects on GitHub
15 repositories on Data Extraction, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
Firecrawl Web API
Firecrawl provides a simple API for searching, scraping, and interacting with web pages, optimized for use in AI applications.
★ 118,560 · TypeScriptOPEN SOURCE CRAWLER FOR LLM
Crawl4ai turns any site into clean Markdown ready for RAG and agents. 84k GitHub stars, run locally or via cloud.
★ 87,369 · PythonAdaptive web scraper
An adaptive framework for web scraping that supports both single requests and large-scale crawlers.
★ 49,091 · PythonSTAGEHAND SDK FOR BROWSER WEB AGENTS
Stagehand provides TypeScript SDK for creating browser agents that can interact, search, extract, and fetch data from any website reliably across the web. It simplifies a
★ 26,054 · TypeScriptScrapegraph: AI scraper on Python
Library for web scraping using artificial intelligence. Automatically extracts structured data from any web page.
★ 25,439 · PythonAGENT FOR SCORING LINKS IN CHAT
Noria is an agentic extractor for messengers. Receives messages and URLs, scrapes web pages, evaluates content via custom matrices (jobs, scholarships), and sends a struc
★ 4,630 · JavaScriptBRIGHTDATA-MCP: SINGLE SOLUTION FOR WEB
Model Context Protocol server for accessing public web data without complex setup.
★ 2,434 · JavaScriptCONTEXTGEM: LLM DOCUMENT EXTRACTION
ContextGem lets you extract structured data from any document using LLMs without complex code.
★ 1,844 · PythonBROWSER AUTOMATION FOR AI AGENTS
CLI tool for browser automation with built-in anti‑bot bypass, human task handoff, and parallel execution across multiple sessions.
★ 1,429 · PythonFAST ALTERNATIVE FIRECRAWL IN RUST
crw — fast Firecrawl/Tavily alternative in Rust: web scraper, crawler and search API with MCP server for AI agents. Compatible API (/scrape, /crawl, /search), runs 2.3× f
★ 1,257 · RustPDF_OXIDE — FASTEST PDF
The fastest PDF library for Python and Rust. Extract text/images, convert to markdown, create and edit.
★ 793 · RustHACKER-NEWS-DIGEST - READ FASTER WITH AI
Automatically summarizes fresh Hacker News with ChatGPT so you stay updated without extra reading.
★ 754 · PythonINFRASTRUCTURE FOR AI AGENTS
Open web toolkit for AI: scraping, crawling, clean Markdown, and browser sessions ready for your agents.
★ 565 · TypeScriptRust Web Crawler for AI
High-performance Rust crawler extracting clean Markdown and structured data for AI agents and RAG pipelines. Supports PDF/RSS parsing, browser rendering, and Firecrawl-co
★ 272 · RustX-TWITTER SCRAPER API ALTERNATIVE
X-Twitter scraper provides REST, MCP, SDK and webhooks for extracting tweets, search, exporting followers and working with AI agents. It is an independent alternative to
★ 229 · JavaScriptNew projects on this topic in Telegram
Telegram →