R_REDDYX.XYZ
AIMDX★ 3,547⑂ 374 forksMIT

any4ai/AnyCrawl

ANY SITE TO LLM DATA

AnyCrawl — a Node.js crawler that turns websites into LLM‑ready data and extracts structured search results from Google, Bing, Baidu, and others.

// KEY FEATURES

  • Website parsing to LLM format
  • SERP extraction from 6+ search engines
  • Multithreaded request processing
#ai-scraping#aitools#crawl#data#html-to-markdown#rag#scrape#scraping#serp#webscraper
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

OpenAgents — AI Agent Networks★ 3555EchoBird One-Click Install★ 3557Open AI Catalog★ 3559FREEHIRE — FREE JOB SEARCH★ 3532Grok Bot 0.18 Reconstruction★ 3562Sprix Sage Router★ 3563

← FULL CATALOG

any4ai/AnyCrawl — Any Site TO LLM Data | REDDYX AI