R_REDDYX.XYZ

Data Extraction: open-source projects on GitHub

15 repositories on Data Extraction, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

Web Scraping 53LLM 2094AI Agents 1319Crawler 13Markdown 98Web Crawler 12MCP 1601Scraping 15RAG 533Automation 272MCP Server 631Scraper 15Playwright 60AI Agent 690
firecrawl/firecrawl

Firecrawl Web API

Firecrawl provides a simple API for searching, scraping, and interacting with web pages, optimized for use in AI applications.

★ 118,560 · TypeScript
unclecode/crawl4ai

OPEN SOURCE CRAWLER FOR LLM

Crawl4ai turns any site into clean Markdown ready for RAG and agents. 84k GitHub stars, run locally or via cloud.

★ 87,369 · Python
D4Vinci/Scrapling

Adaptive web scraper

An adaptive framework for web scraping that supports both single requests and large-scale crawlers.

★ 49,091 · Python
browserbase/stagehand

STAGEHAND SDK FOR BROWSER WEB AGENTS

Stagehand provides TypeScript SDK for creating browser agents that can interact, search, extract, and fetch data from any website reliably across the web. It simplifies a

★ 26,054 · TypeScript
ScrapeGraphAI/Scrapegraph-ai

Scrapegraph: AI scraper on Python

Library for web scraping using artificial intelligence. Automatically extracts structured data from any web page.

★ 25,439 · Python
AhmadHassan-BTed/Noria

AGENT FOR SCORING LINKS IN CHAT

Noria is an agentic extractor for messengers. Receives messages and URLs, scrapes web pages, evaluates content via custom matrices (jobs, scholarships), and sends a struc

★ 4,630 · JavaScript
brightdata/brightdata-mcp

BRIGHTDATA-MCP: SINGLE SOLUTION FOR WEB

Model Context Protocol server for accessing public web data without complex setup.

★ 2,434 · JavaScript
shcherbak-ai/contextgem

CONTEXTGEM: LLM DOCUMENT EXTRACTION

ContextGem lets you extract structured data from any document using LLMs without complex code.

★ 1,844 · Python
browser-act/skills

BROWSER AUTOMATION FOR AI AGENTS

CLI tool for browser automation with built-in anti‑bot bypass, human task handoff, and parallel execution across multiple sessions.

★ 1,429 · Python
fastcrw/crw

FAST ALTERNATIVE FIRECRAWL IN RUST

crw — fast Firecrawl/Tavily alternative in Rust: web scraper, crawler and search API with MCP server for AI agents. Compatible API (/scrape, /crawl, /search), runs 2.3× f

★ 1,257 · Rust
yfedoseev/pdf_oxide

PDF_OXIDE — FASTEST PDF

The fastest PDF library for Python and Rust. Extract text/images, convert to markdown, create and edit.

★ 793 · Rust
polyrabbit/hacker-news-digest

HACKER-NEWS-DIGEST - READ FASTER WITH AI

Automatically summarizes fresh Hacker News with ChatGPT so you stay updated without extra reading.

★ 754 · Python
vakra-dev/reader

INFRASTRUCTURE FOR AI AGENTS

Open web toolkit for AI: scraping, crawling, clean Markdown, and browser sessions ready for your agents.

★ 565 · TypeScript
YOLOW92/pagesift

Rust Web Crawler for AI

High-performance Rust crawler extracting clean Markdown and structured data for AI agents and RAG pipelines. Supports PDF/RSS parsing, browser rendering, and Firecrawl-co

★ 272 · Rust
Xquik-dev/x-twitter-scraper

X-TWITTER SCRAPER API ALTERNATIVE

X-Twitter scraper provides REST, MCP, SDK and webhooks for extracting tweets, search, exporting followers and working with AI agents. It is an independent alternative to

★ 229 · JavaScript

New projects on this topic in Telegram

Telegram →
Data Extraction — 15 open-source GitHub projects | REDDYX AI